Jul 23 14:58:27.863330 ip-10-0-142-206 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 14:58:27.863343 ip-10-0-142-206 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 14:58:27.863353 ip-10-0-142-206 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 14:58:27.863706 ip-10-0-142-206 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 14:58:38.109777 ip-10-0-142-206 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 14:58:38.109795 ip-10-0-142-206 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot acf780e0bb294006a5bbdd08835611c0 --
Jul 23 15:00:13.527248 ip-10-0-142-206 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 15:00:13.990663 ip-10-0-142-206 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:00:13.990663 ip-10-0-142-206 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 15:00:13.990663 ip-10-0-142-206 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:00:13.990663 ip-10-0-142-206 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 15:00:13.990663 ip-10-0-142-206 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:00:13.990663 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.988414    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997505    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997519    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997523    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997526    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997531    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997536    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997540    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997543    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997547    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997550    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997553    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997555    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997558    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997561    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997564    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997567    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997570    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997573    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:14.010625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997576    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997578    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997581    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997583    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997586    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997589    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997593    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997595    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997598    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997601    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997604    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997606    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997609    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997611    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997614    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997617    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997619    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997622    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997626    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997628    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:14.013407 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997631    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997633    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997636    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997639    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997641    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997644    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997646    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997649    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997651    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997655    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997657    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997660    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997663    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997666    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997668    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997671    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997673    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997676    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997679    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997681    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:14.060904 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997683    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997686    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997688    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997691    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997693    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997696    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997699    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997701    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997704    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997707    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997710    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997712    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997715    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997717    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997720    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997722    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997726    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997729    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997731    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:14.062883 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997734    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997737    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997742    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997745    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997748    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997750    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997753    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997756    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997759    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997762    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997765    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997768    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997771    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997774    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997777    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997780    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997784    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997787    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997790    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997793    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:14.083042 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997796    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.997799    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998520    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998527    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998530    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998533    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998536    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998539    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998542    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998545    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998548    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998550    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998553    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998555    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998558    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998561    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998564    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998567    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998571    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:14.098138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998576    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:14.077427 ip-10-0-142-206 systemd[1]: Started Kubernetes Kubelet.
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998579    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998582    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998586    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998590    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998593    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998596    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998600    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998602    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998605    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998608    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998611    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998614    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998617    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998619    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998622    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998625    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998627    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998630    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:14.132925 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998633    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998635    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998638    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998640    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998643    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998646    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998648    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998651    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998654    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998656    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998659    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998662    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998665    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998667    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998673    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998675    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998678    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998680    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998683    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998686    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:14.135238 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998688    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998691    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998693    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998696    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998698    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998701    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998704    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998706    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998709    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998711    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998714    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998716    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998719    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998722    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998724    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998727    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998729    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998732    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998735    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998737    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:14.361494 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998740    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998742    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998745    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998748    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998750    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998754    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998758    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998761    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998764    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998766    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998769    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998771    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998774    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998778    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998782    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998785    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998787    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998790    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998792    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998795    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:14.380454 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998798    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998800    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.998802    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999231    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999238    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999241    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999244    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999247    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999250    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999253    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999255    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999258    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999261    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999263    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999266    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999269    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999271    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999274    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999278    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:14.383520 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999281    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999286    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999289    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999292    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999295    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999297    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999300    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999303    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999306    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999308    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999311    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999314    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999316    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999319    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999321    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999325    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999329    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999332    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999335    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:14.385356 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999337    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999340    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999343    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999345    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999348    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999351    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999353    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999356    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999358    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999361    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999363    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999366    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999370    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999372    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999375    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999382    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999385    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999388    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999391    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:14.387100 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999393    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999397    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999399    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999402    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999404    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999407    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999409    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999412    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999414    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999417    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999419    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999422    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999424    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999427    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999429    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999432    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999434    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999437    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999439    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999442    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:14.393512 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999444    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999447    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999449    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999452    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999454    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999460    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999463    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999465    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999471    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999473    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999476    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999479    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999481    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999484    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999486    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999489    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999492    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999495    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999497    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999500    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:14.394319 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999502    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999505    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999508    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999510    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:13.999513    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999581    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999592    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999600    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999604    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999608    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999611    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999615    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999619    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999623    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999626    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999629    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999632    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999637    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999640    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999643    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999647    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999651    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999654    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 15:00:14.395129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999658    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999660    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999663    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999666    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999670    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999673    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999676    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999679    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999682    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999686    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999689    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999692    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999695    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999698    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999702    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999705    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999708    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999711    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999714    2575 flags.go:64] FLAG: --enable-server="true"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999717    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999721    2575 flags.go:64] FLAG: --event-burst="100"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999724    2575 flags.go:64] FLAG: --event-qps="50"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999727    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999730    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 15:00:14.397150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999733    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999736    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999741    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999744    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999747    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999752    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999754    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999758    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999761    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999764    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999767    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999770    2575 flags.go:64] FLAG: --feature-gates=""
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999774    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999777    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999780    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999783    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999786    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999789    2575 flags.go:64] FLAG: --help="false"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999791    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-206.ec2.internal"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999795    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999797    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999800    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999803    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 15:00:14.397953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999807    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999810    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999813    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999815    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999818    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999821    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999824    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999827    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999830    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999832    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999835    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999839    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999842    2575 flags.go:64] FLAG: --lock-file=""
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999845    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999849    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999852    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999857    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999861    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999864    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999866    2575 flags.go:64] FLAG: --logging-format="text"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999869    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999872    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999875    2575 flags.go:64] FLAG: --manifest-url=""
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999878    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999882    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 15:00:14.398735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999885    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999902    2575 flags.go:64] FLAG: --max-pods="110"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999905    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999908    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999911    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999914    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999917    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999920    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999923    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999930    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999933    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999936    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999939    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999942    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999947    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999949    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999953    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999956    2575 flags.go:64] FLAG: --port="10250"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999958    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999962    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00ea88073d561cca1"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999966    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999970    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999973    2575 flags.go:64] FLAG: --register-node="true"
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999976    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 23 15:00:14.401551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999979    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999983    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999986    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999988    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999992    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999995    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:13.999998    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000001    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000003    2575 flags.go:64] FLAG: --runonce="false"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000006    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000009    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000012    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000015    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000018    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000021    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000024    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000026    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000029    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000032    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000035    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000037    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000040    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000043    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000046    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000051    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 15:00:14.402347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000054    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000056    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000062    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000065    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000069    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000072    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000075    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000078    2575 flags.go:64] FLAG: --v="2"
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000082    2575 flags.go:64] FLAG: --version="false"
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000087    2575 flags.go:64] FLAG: --vmodule=""
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000091    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.000094    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000202    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000206    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000209    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000212    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000215    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000218    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000221    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000224    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000226    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:14.404346 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000230    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000234    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000237    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000240    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000242    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000246    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000250    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000253    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000255    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000258    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000261    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000264    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000267    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000271    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000274    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000278    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000281    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000284    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000286    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000289    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:14.405148 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000292    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000295    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000298    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000300    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000303    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000305    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000308    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000310    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000313    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000315    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000318    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000321    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000323    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000326    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000328    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000331    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000334    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000336    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000338    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000342    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:14.407160 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000344    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000346    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000349    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000351    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000354    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000358    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000361    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000365    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000368    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000370    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000373    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000376    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000378    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000381    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000384    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000387    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000389    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000392    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000394    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000396    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:14.407959 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000399    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000401    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000404    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000406    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000409    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000411    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000414    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000416    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000419    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000421    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000424    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000427    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000429    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000432    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000434    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000437    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000439    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000444    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000447    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:14.408740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000451    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000455    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000458    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000461    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000464    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000467    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000470    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000473    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000476    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000479    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.000481    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.001313    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.008534    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.008549    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 15:00:14.409531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.009367    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.009377    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009435    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009441    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009445    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009448    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009450    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009453    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009457    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009460    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009463    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009465    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009468    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009470    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009473    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009476    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009479    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009482    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009484    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:14.410323 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009487    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009490    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009493    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009495    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009498    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009501    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009504    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009507    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009509    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009512    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009514    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009517    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009520    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009523    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009526    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009529    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009531    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009534    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009537    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009539    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:14.411135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009542    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009544    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009547    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009549    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009552    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009555    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009557    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009560    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009565    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009568    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009570    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009573    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009576    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009578    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009581    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009583    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009587    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009591    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009595    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:14.411950 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009597    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009600    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009603    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009606    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009608    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009611    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009615    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009619    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009622    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009624    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009627    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009630    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009633    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009636    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009639    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009642    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009644    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009647    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009650    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:14.412728 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009653    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009655    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009659    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009662    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009665    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009667    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009671    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009674    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009677    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009680    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009683    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009687    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009689    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009692    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009694    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009697    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009700    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009703    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009706    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009709    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:14.413530 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009712    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009714    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009717    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009720    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.009724    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009833    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009837    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009840    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009843    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009846    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009848    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009852    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009854    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009857    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009860    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:14.414324 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009864    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009868    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009870    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009873    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009876    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009879    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009882    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009885    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009904    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009908    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009911    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009913    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009916    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009919    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009923    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009925    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009928    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009931    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009934    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:14.415139 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009937    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009939    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009942    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009944    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009948    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009951    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009953    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009956    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009959    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009962    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009964    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009967    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009969    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009974    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009977    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009980    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009982    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009985    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009988    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009992    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:14.415933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009995    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.009998    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010000    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010003    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010006    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010009    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010013    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010016    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010019    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010022    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010025    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010028    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010031    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010033    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010036    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010039    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010042    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010044    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010047    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:14.513740 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010049    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010052    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010054    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010057    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010060    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010062    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010066    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010069    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010071    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010074    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010076    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010079    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010082    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010085    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010088    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010090    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010093    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010095    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010098    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010100    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:14.514543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010102    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010105    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010108    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010110    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010113    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010115    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010118    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010120    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010123    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010126    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:14.010129    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.010135    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.010246    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.012644    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 15:00:14.516953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.014324    2575 server.go:1019] "Starting client certificate rotation"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.014422    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.014453    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.017303    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.020043    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.036356    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.038802    2575 log.go:25] "Validated CRI v1 image API"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.040525    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.043289    2575 fs.go:135] Filesystem UUIDs: map[4de8e5dd-5c4b-4abd-b468-013adaf218cb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f87770fb-f779-4190-9d2a-f5ea7113112a:/dev/nvme0n1p4]
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.043305    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 15:00:14.517737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.047255    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.049224    2575 manager.go:216] Machine: {Timestamp:2026-07-23 15:00:14.0479143 +0000 UTC m=+0.386124735 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3053976 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2867573b6e7387294539fe9df2ab56 SystemUUID:ec286757-3b6e-7387-2945-39fe9df2ab56 BootID:acf780e0-bb29-4006-a5bb-dd08835611c0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:5d:80:87:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:5d:80:87:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:b8:63:83:75:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.049325    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.049409    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.052942    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.052966    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-206.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.053847    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.053855    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.053862    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.053875    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.055884    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.060750    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.060875    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.060920    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.060930    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.060953    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.060963    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.060974    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 15:00:14.519336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.061284    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.061297    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.063737    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.066407    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.066436    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.067223    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cf7q6"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068018    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068042    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068055    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068070    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068088    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068100    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068113    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068119    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068126    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068132    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068140    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.068146    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.069022    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.069034    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.072406    2575 server.go:1268] "Started kubelet"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.072492    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.077671    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-206.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.077933    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.078117    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.078169    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.078233    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.078451    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cf7q6"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.080696    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.084451    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.085338    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.085669    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-206.ec2.internal.18c4f3414937d399  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-206.ec2.internal,UID:ip-10-0-142-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-206.ec2.internal,},FirstTimestamp:2026-07-23 15:00:14.072378265 +0000 UTC m=+0.410588877,LastTimestamp:2026-07-23 15:00:14.072378265 +0000 UTC m=+0.410588877,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-206.ec2.internal,}"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.093190    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.093194    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.093383    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-206.ec2.internal\" not found"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.093921    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.093937    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.093921    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094017    2575 factory.go:55] Registering systemd factory
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094035    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 23 15:00:14.520138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094022    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094086    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094242    2575 factory.go:153] Registering CRI-O factory
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094256    2575 factory.go:223] Registration of the crio container factory successfully
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094302    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094323    2575 factory.go:103] Registering Raw factory
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094336    2575 manager.go:1196] Started watching for new ooms in manager
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.094766    2575 manager.go:349] Starting recovery of all containers
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.098886    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.100674    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-206.ec2.internal\" not found" node="ip-10-0-142-206.ec2.internal"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.107445    2575 manager.go:354] Recovery completed
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.111762    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.114486    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.114524    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.114541    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.115072    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.115092    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.115109    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.115124    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.115823    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.115853    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.115866    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.117258    2575 policy_none.go:49] "None policy: Start"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.117272    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.117282    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.119298    2575 policy_none.go:47] "Start"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.193853    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-206.ec2.internal\" not found"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.214570    2575 manager.go:337] "Starting Device Plugin manager"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.214600    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.214609    2575 server.go:87] "Starting device plugin registration server"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.214884    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.214917    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.215019    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.215119    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.215127    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.215628    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.215683    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-206.ec2.internal\" not found"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.233591    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.234865    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.234927    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.234953    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.234998    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.238536    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.315669    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.316772    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.316799    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.316809    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.316836    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-206.ec2.internal"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.329114    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-206.ec2.internal"
Jul 23 15:00:14.521343 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.329136    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-206.ec2.internal\": node \"ip-10-0-142-206.ec2.internal\" not found"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.335555    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal"]
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.335608    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.336458    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.336485    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.336496    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.338709    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.338880    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.338927    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.339370    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.339397    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.339371    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.339413    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.339430    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.339442    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.341615    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.341636    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.342295    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.342325    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:14.342339    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.353264    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-206.ec2.internal\" not found"
Jul 23 15:00:14.522963 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:14.381524    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-206.ec2.internal\" not found" node="ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.027581 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.027502    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 15:00:17.027581 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:17.027532    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-206.ec2.internal\" not found"
Jul 23 15:00:17.027581 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.027518    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 14:55:15 +0000 UTC" deadline="2028-01-04 04:37:29.316050118 +0000 UTC"
Jul 23 15:00:17.027581 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.027573    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12709h37m12.288483242s"
Jul 23 15:00:17.028212 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.027658    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection force closed via ClientConn.Close\") has prevented the request from succeeding"
Jul 23 15:00:17.028212 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.027658    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection force closed via ClientConn.Close\") has prevented the request from succeeding"
Jul 23 15:00:17.029820 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:17.029805    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-206.ec2.internal\" not found" node="ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.127964 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:17.127866    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-206.ec2.internal\" not found"
Jul 23 15:00:17.128088 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.127964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e32e28f99e932c6f7c7566e18b3ac731-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal\" (UID: \"e32e28f99e932c6f7c7566e18b3ac731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.128088 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.127989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e32e28f99e932c6f7c7566e18b3ac731-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal\" (UID: \"e32e28f99e932c6f7c7566e18b3ac731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.128088 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.128011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42e6b728db4eca8974e361f2558a6eea-config\") pod \"kube-apiserver-proxy-ip-10-0-142-206.ec2.internal\" (UID: \"42e6b728db4eca8974e361f2558a6eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.171318 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.171292    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:17.218039 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.218007    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.228284 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.228262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42e6b728db4eca8974e361f2558a6eea-config\") pod \"kube-apiserver-proxy-ip-10-0-142-206.ec2.internal\" (UID: \"42e6b728db4eca8974e361f2558a6eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.228333 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.228289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e32e28f99e932c6f7c7566e18b3ac731-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal\" (UID: \"e32e28f99e932c6f7c7566e18b3ac731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.228333 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.228305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e32e28f99e932c6f7c7566e18b3ac731-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal\" (UID: \"e32e28f99e932c6f7c7566e18b3ac731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.228414 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.228351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e32e28f99e932c6f7c7566e18b3ac731-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal\" (UID: \"e32e28f99e932c6f7c7566e18b3ac731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.228414 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.228376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42e6b728db4eca8974e361f2558a6eea-config\") pod \"kube-apiserver-proxy-ip-10-0-142-206.ec2.internal\" (UID: \"42e6b728db4eca8974e361f2558a6eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.228414 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.228377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e32e28f99e932c6f7c7566e18b3ac731-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal\" (UID: \"e32e28f99e932c6f7c7566e18b3ac731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.238887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.238867    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:00:17.240375 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.240363    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.251429 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.251412    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:00:17.255892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.255865    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:17.332722 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.332701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.508715 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.508602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal"
Jul 23 15:00:17.842485 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.842428    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:17.961592 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:17.961567    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:18.002987 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.002956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e6b728db4eca8974e361f2558a6eea.slice/crio-5cbe670608c19658a9caffaf0147965599387da1f6acf8da63d864611c0f53d2 WatchSource:0}: Error finding container 5cbe670608c19658a9caffaf0147965599387da1f6acf8da63d864611c0f53d2: Status 404 returned error can't find the container with id 5cbe670608c19658a9caffaf0147965599387da1f6acf8da63d864611c0f53d2
Jul 23 15:00:18.006952 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.006933    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:00:18.028519 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.028487    2575 apiserver.go:52] "Watching apiserver"
Jul 23 15:00:18.028980 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.028499    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 15:00:18.030545 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.030506    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal" event={"ID":"42e6b728db4eca8974e361f2558a6eea","Type":"ContainerStarted","Data":"5cbe670608c19658a9caffaf0147965599387da1f6acf8da63d864611c0f53d2"}
Jul 23 15:00:18.037382 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.037361    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 15:00:18.037704 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.037684    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cr6qw","openshift-image-registry/node-ca-nnzhk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal","openshift-multus/multus-w44bd","openshift-multus/network-metrics-daemon-mflwc","openshift-network-diagnostics/network-check-target-9wgr5","openshift-ovn-kubernetes/ovnkube-node-bqg6p","kube-system/konnectivity-agent-7fs78","kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph","openshift-cluster-node-tuning-operator/tuned-kcmz4","openshift-dns/node-resolver-sqtn7","openshift-multus/multus-additional-cni-plugins-9645x","openshift-network-operator/iptables-alerter-6ss69"]
Jul 23 15:00:18.041373 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.041356    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:18.041452 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.041416    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:18.042117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.042094    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:00:18.043855 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.043840    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.046267 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.046244    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:00:18.046347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.046319    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nhw5p\""
Jul 23 15:00:18.046409 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.046363    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 15:00:18.046624 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.046603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.048838 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.048817    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.049237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.049216    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 15:00:18.049352 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.049248    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 15:00:18.049352 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.049270    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5s4x4\""
Jul 23 15:00:18.051140 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.051124    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 15:00:18.051140 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.051133    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.051675 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.051659    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 15:00:18.051787 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.051769    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 15:00:18.051861 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.051824    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smvq6\""
Jul 23 15:00:18.051861 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.051839    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 15:00:18.051996 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.051925    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 15:00:18.052253 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.052240    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 15:00:18.053579 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.053562    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:18.053664 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.053626    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:18.053889 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.053873    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 15:00:18.053985 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.053944    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 15:00:18.053985 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.053955    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bqxb6\""
Jul 23 15:00:18.053985 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.053964    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 15:00:18.054247 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.054230    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 15:00:18.055863 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.055847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.055947 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.055927    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:18.058106 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.058085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.060264 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.060243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.061113 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.061094    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 15:00:18.061255 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.061229    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lbhqk\""
Jul 23 15:00:18.061350 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.061265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 15:00:18.061460 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.061265    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 15:00:18.064844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.064561    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 15:00:18.064844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.064603    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 15:00:18.064844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.064653    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 15:00:18.065025 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.064957    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.065754 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.065707    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5gs5\""
Jul 23 15:00:18.067193 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.067158    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 15:00:18.067286 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.067160    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7phl2\""
Jul 23 15:00:18.067658 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.067634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.067748 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.067731    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 15:00:18.069904 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.069887    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.070182 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.070143    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 15:00:18.070384 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.070364    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 15:00:18.070384 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.070381    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ndmjg\""
Jul 23 15:00:18.072675 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.072651    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsfvk\""
Jul 23 15:00:18.072675 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.072670    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 15:00:18.072819 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.072727    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:00:18.072975 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.072954    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qcsdv"
Jul 23 15:00:18.073100 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.073087    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 15:00:18.081384 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.081368    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qcsdv"
Jul 23 15:00:18.119881 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.119855    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 15:00:18.132657 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/526ec536-972b-4ef3-9912-ff9b52a57905-hosts-file\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.132745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1057446-c158-4ba8-9c57-ddf3ec05cab7-iptables-alerter-script\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.132745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c09f591f-5743-4ced-ab17-11cc126d4894-etc-tuned\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.132745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtdgl\" (UniqueName: \"kubernetes.io/projected/c09f591f-5743-4ced-ab17-11cc126d4894-kube-api-access-wtdgl\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.132745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-var-lib-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.132892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-node-log\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.132892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.132892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-kubernetes\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.132892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-host\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.132892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-multus-certs\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.132892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysconfig\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.132892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfb5p\" (UniqueName: \"kubernetes.io/projected/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-kube-api-access-mfb5p\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysctl-d\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysctl-conf\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.132999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-run\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-kubelet\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-etc-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133095 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-os-release\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck6l2\" (UniqueName: \"kubernetes.io/projected/9245f8f3-143a-4c8e-9489-9169a0c835ad-kube-api-access-ck6l2\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1057446-c158-4ba8-9c57-ddf3ec05cab7-host-slash\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-systemd\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6432ee70-0ca6-42a7-aab0-4837a8a0518f-konnectivity-ca\") pod \"konnectivity-agent-7fs78\" (UID: \"6432ee70-0ca6-42a7-aab0-4837a8a0518f\") " pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c41277be-6889-44cf-8587-f6b679eb5385-cni-binary-copy\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133224    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-device-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-run-netns\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovnkube-script-lib\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g848c\" (UniqueName: \"kubernetes.io/projected/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-kube-api-access-g848c\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-os-release\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-netns\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-kubelet\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c41277be-6889-44cf-8587-f6b679eb5385-multus-daemon-config\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.133398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526ec536-972b-4ef3-9912-ff9b52a57905-tmp-dir\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-log-socket\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovn-node-metrics-cert\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfpc9\" (UniqueName: \"kubernetes.io/projected/ad5522ce-1e49-4afd-91f3-c292f2cc691b-kube-api-access-tfpc9\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-system-cni-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-cnibin\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-cni-bin\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-socket-dir-parent\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-cni-bin\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-registration-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4hp\" (UniqueName: \"kubernetes.io/projected/b1057446-c158-4ba8-9c57-ddf3ec05cab7-kube-api-access-dn4hp\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-cni-netd\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/676860b9-b9bd-469c-9dcb-d05491dbcba2-kubelet-config\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.133926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-cni-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-k8s-cni-cncf-io\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-cni-multus\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8lt\" (UniqueName: \"kubernetes.io/projected/c41277be-6889-44cf-8587-f6b679eb5385-kube-api-access-9j8lt\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-modprobe-d\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c09f591f-5743-4ced-ab17-11cc126d4894-tmp\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-slash\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-ovn\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-env-overrides\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-serviceca\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.133987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-hostroot\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-var-lib-kubelet\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-host\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-conf-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-etc-kubernetes\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134107    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s878d\" (UniqueName: \"kubernetes.io/projected/526ec536-972b-4ef3-9912-ff9b52a57905-kube-api-access-s878d\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.134540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-sys\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134183    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-sys-fs\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm7h6\" (UniqueName: \"kubernetes.io/projected/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-kube-api-access-wm7h6\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-lib-modules\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-systemd-units\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovnkube-config\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-system-cni-dir\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-systemd\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6432ee70-0ca6-42a7-aab0-4837a8a0518f-agent-certs\") pod \"konnectivity-agent-7fs78\" (UID: \"6432ee70-0ca6-42a7-aab0-4837a8a0518f\") " pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-cnibin\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-socket-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/676860b9-b9bd-469c-9dcb-d05491dbcba2-dbus\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.135069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.134529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.187583 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.187552    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32e28f99e932c6f7c7566e18b3ac731.slice/crio-cb2e7129b6c11bb350b59abb0161d37e615eaa7adec668552110eb3fda3d166a WatchSource:0}: Error finding container cb2e7129b6c11bb350b59abb0161d37e615eaa7adec668552110eb3fda3d166a: Status 404 returned error can't find the container with id cb2e7129b6c11bb350b59abb0161d37e615eaa7adec668552110eb3fda3d166a
Jul 23 15:00:18.234838 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-system-cni-dir\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.234838 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-systemd\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6432ee70-0ca6-42a7-aab0-4837a8a0518f-agent-certs\") pod \"konnectivity-agent-7fs78\" (UID: \"6432ee70-0ca6-42a7-aab0-4837a8a0518f\") " pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-cnibin\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-socket-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-system-cni-dir\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-systemd\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.234989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-cnibin\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:18.235083 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/676860b9-b9bd-469c-9dcb-d05491dbcba2-dbus\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.235114    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/526ec536-972b-4ef3-9912-ff9b52a57905-hosts-file\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235098    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-socket-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1057446-c158-4ba8-9c57-ddf3ec05cab7-iptables-alerter-script\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.235192    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs podName:5aaed50c-e7c8-4c83-9934-2e4c6e1580c8 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:18.735152747 +0000 UTC m=+3.449084675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs") pod "network-metrics-daemon-mflwc" (UID: "5aaed50c-e7c8-4c83-9934-2e4c6e1580c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.235229    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.235292    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret podName:676860b9-b9bd-469c-9dcb-d05491dbcba2 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:18.735270207 +0000 UTC m=+3.449202150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret") pod "global-pull-secret-syncer-cr6qw" (UID: "676860b9-b9bd-469c-9dcb-d05491dbcba2") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/676860b9-b9bd-469c-9dcb-d05491dbcba2-dbus\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c09f591f-5743-4ced-ab17-11cc126d4894-etc-tuned\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235328    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/526ec536-972b-4ef3-9912-ff9b52a57905-hosts-file\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtdgl\" (UniqueName: \"kubernetes.io/projected/c09f591f-5743-4ced-ab17-11cc126d4894-kube-api-access-wtdgl\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-var-lib-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-node-log\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.235651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235482    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-kubernetes\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-var-lib-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-kubernetes\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-node-log\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-host\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-multus-certs\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysconfig\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-host\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-multus-certs\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfb5p\" (UniqueName: \"kubernetes.io/projected/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-kube-api-access-mfb5p\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1057446-c158-4ba8-9c57-ddf3ec05cab7-iptables-alerter-script\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysconfig\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysctl-d\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysctl-conf\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.236494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-run\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-kubelet\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysctl-d\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-run\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-sysctl-conf\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-etc-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-os-release\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-kubelet\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck6l2\" (UniqueName: \"kubernetes.io/projected/9245f8f3-143a-4c8e-9489-9169a0c835ad-kube-api-access-ck6l2\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1057446-c158-4ba8-9c57-ddf3ec05cab7-host-slash\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.235993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-etc-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-systemd\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6432ee70-0ca6-42a7-aab0-4837a8a0518f-konnectivity-ca\") pod \"konnectivity-agent-7fs78\" (UID: \"6432ee70-0ca6-42a7-aab0-4837a8a0518f\") " pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c41277be-6889-44cf-8587-f6b679eb5385-cni-binary-copy\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-os-release\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1057446-c158-4ba8-9c57-ddf3ec05cab7-host-slash\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-device-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.237362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-device-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-run-netns\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-run-netns\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-systemd\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovnkube-script-lib\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g848c\" (UniqueName: \"kubernetes.io/projected/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-kube-api-access-g848c\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-os-release\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-netns\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-kubelet\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c41277be-6889-44cf-8587-f6b679eb5385-multus-daemon-config\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526ec536-972b-4ef3-9912-ff9b52a57905-tmp-dir\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-netns\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236504    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-log-socket\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.238240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236533    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-os-release\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovn-node-metrics-cert\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfpc9\" (UniqueName: \"kubernetes.io/projected/ad5522ce-1e49-4afd-91f3-c292f2cc691b-kube-api-access-tfpc9\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-system-cni-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-cnibin\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-cni-bin\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c41277be-6889-44cf-8587-f6b679eb5385-cni-binary-copy\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-socket-dir-parent\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-cni-bin\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-kubelet\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-registration-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4hp\" (UniqueName: \"kubernetes.io/projected/b1057446-c158-4ba8-9c57-ddf3ec05cab7-kube-api-access-dn4hp\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6432ee70-0ca6-42a7-aab0-4837a8a0518f-konnectivity-ca\") pod \"konnectivity-agent-7fs78\" (UID: \"6432ee70-0ca6-42a7-aab0-4837a8a0518f\") " pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-cni-netd\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/676860b9-b9bd-469c-9dcb-d05491dbcba2-kubelet-config\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.239048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526ec536-972b-4ef3-9912-ff9b52a57905-tmp-dir\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-cni-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-k8s-cni-cncf-io\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-registration-dir\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-cni-multus\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8lt\" (UniqueName: \"kubernetes.io/projected/c41277be-6889-44cf-8587-f6b679eb5385-kube-api-access-9j8lt\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.236953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-cni-multus\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237019    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9245f8f3-143a-4c8e-9489-9169a0c835ad-cnibin\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c41277be-6889-44cf-8587-f6b679eb5385-multus-daemon-config\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovnkube-script-lib\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-socket-dir-parent\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237210    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-cni-netd\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237222    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-cni-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-var-lib-cni-bin\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-system-cni-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.239637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-cni-bin\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237347    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/676860b9-b9bd-469c-9dcb-d05491dbcba2-kubelet-config\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-log-socket\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-openvswitch\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-host-run-k8s-cni-cncf-io\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-modprobe-d\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c09f591f-5743-4ced-ab17-11cc126d4894-tmp\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-slash\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-ovn\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-env-overrides\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-serviceca\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237652    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-run-ovn\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-slash\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-hostroot\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-var-lib-kubelet\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-host\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-conf-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237762    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-etc-kubernetes\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.240104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s878d\" (UniqueName: \"kubernetes.io/projected/526ec536-972b-4ef3-9912-ff9b52a57905-kube-api-access-s878d\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-sys\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-sys-fs\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm7h6\" (UniqueName: \"kubernetes.io/projected/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-kube-api-access-wm7h6\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-lib-modules\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-systemd-units\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.237992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-env-overrides\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-serviceca\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovnkube-config\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-sys-fs\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-lib-modules\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-systemd-units\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5522ce-1e49-4afd-91f3-c292f2cc691b-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238340    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-etc-kubernetes\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238347    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-multus-conf-dir\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-host\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.240603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-etc-modprobe-d\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-var-lib-kubelet\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c09f591f-5743-4ced-ab17-11cc126d4894-sys\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238475    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c41277be-6889-44cf-8587-f6b679eb5385-hostroot\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovnkube-config\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.238925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9245f8f3-143a-4c8e-9489-9169a0c835ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.239307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c09f591f-5743-4ced-ab17-11cc126d4894-etc-tuned\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.239484    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5522ce-1e49-4afd-91f3-c292f2cc691b-ovn-node-metrics-cert\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.239515    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6432ee70-0ca6-42a7-aab0-4837a8a0518f-agent-certs\") pod \"konnectivity-agent-7fs78\" (UID: \"6432ee70-0ca6-42a7-aab0-4837a8a0518f\") " pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.241112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.240088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c09f591f-5743-4ced-ab17-11cc126d4894-tmp\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.245699 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.245673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtdgl\" (UniqueName: \"kubernetes.io/projected/c09f591f-5743-4ced-ab17-11cc126d4894-kube-api-access-wtdgl\") pod \"tuned-kcmz4\" (UID: \"c09f591f-5743-4ced-ab17-11cc126d4894\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.245877 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.245675    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:18.245877 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.245763    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:18.245877 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.245779    2575 projected.go:196] Error preparing data for projected volume kube-api-access-w2v5m for pod openshift-network-diagnostics/network-check-target-9wgr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:18.245877 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.245843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m podName:84c23de0-11b9-4e9a-9978-c82b24aa9ea5 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:18.745824979 +0000 UTC m=+3.459756897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w2v5m" (UniqueName: "kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m") pod "network-check-target-9wgr5" (UID: "84c23de0-11b9-4e9a-9978-c82b24aa9ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:18.248362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.248334    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4hp\" (UniqueName: \"kubernetes.io/projected/b1057446-c158-4ba8-9c57-ddf3ec05cab7-kube-api-access-dn4hp\") pod \"iptables-alerter-6ss69\" (UID: \"b1057446-c158-4ba8-9c57-ddf3ec05cab7\") " pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.248484 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.248365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g848c\" (UniqueName: \"kubernetes.io/projected/3b271b25-7c76-47cf-aa1b-f42e1a9b704f-kube-api-access-g848c\") pod \"node-ca-nnzhk\" (UID: \"3b271b25-7c76-47cf-aa1b-f42e1a9b704f\") " pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.248484 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.248367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfpc9\" (UniqueName: \"kubernetes.io/projected/ad5522ce-1e49-4afd-91f3-c292f2cc691b-kube-api-access-tfpc9\") pod \"ovnkube-node-bqg6p\" (UID: \"ad5522ce-1e49-4afd-91f3-c292f2cc691b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.248614 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.248478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfb5p\" (UniqueName: \"kubernetes.io/projected/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-kube-api-access-mfb5p\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:18.248690 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.248669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s878d\" (UniqueName: \"kubernetes.io/projected/526ec536-972b-4ef3-9912-ff9b52a57905-kube-api-access-s878d\") pod \"node-resolver-sqtn7\" (UID: \"526ec536-972b-4ef3-9912-ff9b52a57905\") " pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.248787 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.248770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm7h6\" (UniqueName: \"kubernetes.io/projected/80ed9dd7-8567-4f74-b3ae-0359fa32cfb2-kube-api-access-wm7h6\") pod \"aws-ebs-csi-driver-node-zl9ph\" (UID: \"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.249061 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.249042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8lt\" (UniqueName: \"kubernetes.io/projected/c41277be-6889-44cf-8587-f6b679eb5385-kube-api-access-9j8lt\") pod \"multus-w44bd\" (UID: \"c41277be-6889-44cf-8587-f6b679eb5385\") " pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.249780 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.249761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck6l2\" (UniqueName: \"kubernetes.io/projected/9245f8f3-143a-4c8e-9489-9169a0c835ad-kube-api-access-ck6l2\") pod \"multus-additional-cni-plugins-9645x\" (UID: \"9245f8f3-143a-4c8e-9489-9169a0c835ad\") " pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.353991 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.353907    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcmz4"
Jul 23 15:00:18.360332 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.360309    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:18.363621 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.363599    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09f591f_5743_4ced_ab17_11cc126d4894.slice/crio-8e42b9d630fc0a55baa90f3048fd8f73852c31510b021db2265b1f67088739bd WatchSource:0}: Error finding container 8e42b9d630fc0a55baa90f3048fd8f73852c31510b021db2265b1f67088739bd: Status 404 returned error can't find the container with id 8e42b9d630fc0a55baa90f3048fd8f73852c31510b021db2265b1f67088739bd
Jul 23 15:00:18.368625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.368602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:18.368724 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.368604    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6432ee70_0ca6_42a7_aab0_4837a8a0518f.slice/crio-b34129614888ee041fde00155b6b1a394deab75f2fdf634863ba30a03b941098 WatchSource:0}: Error finding container b34129614888ee041fde00155b6b1a394deab75f2fdf634863ba30a03b941098: Status 404 returned error can't find the container with id b34129614888ee041fde00155b6b1a394deab75f2fdf634863ba30a03b941098
Jul 23 15:00:18.373355 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.373338    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w44bd"
Jul 23 15:00:18.379644 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.379581    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5522ce_1e49_4afd_91f3_c292f2cc691b.slice/crio-8b8dc7e3aa8a4a978b10499541c7ea097e22386d0973431a2360d676795e3f21 WatchSource:0}: Error finding container 8b8dc7e3aa8a4a978b10499541c7ea097e22386d0973431a2360d676795e3f21: Status 404 returned error can't find the container with id 8b8dc7e3aa8a4a978b10499541c7ea097e22386d0973431a2360d676795e3f21
Jul 23 15:00:18.379742 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.379668    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph"
Jul 23 15:00:18.383774 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.383749    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41277be_6889_44cf_8587_f6b679eb5385.slice/crio-cbc25a3c19368744a0e214bce714fa363c9d1b5af5d5101a3b8e1db7b7c5a285 WatchSource:0}: Error finding container cbc25a3c19368744a0e214bce714fa363c9d1b5af5d5101a3b8e1db7b7c5a285: Status 404 returned error can't find the container with id cbc25a3c19368744a0e214bce714fa363c9d1b5af5d5101a3b8e1db7b7c5a285
Jul 23 15:00:18.383774 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.383771    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnzhk"
Jul 23 15:00:18.388311 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.388286    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ed9dd7_8567_4f74_b3ae_0359fa32cfb2.slice/crio-4b7ba83670f61762585e10aac6e924bc04f0903b5c3222ccc73b3414fd1d2da7 WatchSource:0}: Error finding container 4b7ba83670f61762585e10aac6e924bc04f0903b5c3222ccc73b3414fd1d2da7: Status 404 returned error can't find the container with id 4b7ba83670f61762585e10aac6e924bc04f0903b5c3222ccc73b3414fd1d2da7
Jul 23 15:00:18.389193 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.389164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sqtn7"
Jul 23 15:00:18.393110 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.393071    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b271b25_7c76_47cf_aa1b_f42e1a9b704f.slice/crio-0bbe7b6a4cda537ab048c3fae0b220778805ed3c5df3f12c37229c3e6e1501ad WatchSource:0}: Error finding container 0bbe7b6a4cda537ab048c3fae0b220778805ed3c5df3f12c37229c3e6e1501ad: Status 404 returned error can't find the container with id 0bbe7b6a4cda537ab048c3fae0b220778805ed3c5df3f12c37229c3e6e1501ad
Jul 23 15:00:18.395477 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.395460    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9645x"
Jul 23 15:00:18.398660 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.398638    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526ec536_972b_4ef3_9912_ff9b52a57905.slice/crio-91aa64b8846f0dac014c51be47d8e547cdbc8fe038027678cc2eb00dd4148b35 WatchSource:0}: Error finding container 91aa64b8846f0dac014c51be47d8e547cdbc8fe038027678cc2eb00dd4148b35: Status 404 returned error can't find the container with id 91aa64b8846f0dac014c51be47d8e547cdbc8fe038027678cc2eb00dd4148b35
Jul 23 15:00:18.399360 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.399330    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ss69"
Jul 23 15:00:18.405493 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.405470    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9245f8f3_143a_4c8e_9489_9169a0c835ad.slice/crio-6bd9cc99167fcbfa3b775581897f9775814740a4d33f8ff0a0d0e43ef0ba3ad6 WatchSource:0}: Error finding container 6bd9cc99167fcbfa3b775581897f9775814740a4d33f8ff0a0d0e43ef0ba3ad6: Status 404 returned error can't find the container with id 6bd9cc99167fcbfa3b775581897f9775814740a4d33f8ff0a0d0e43ef0ba3ad6
Jul 23 15:00:18.408607 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:18.408590    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1057446_c158_4ba8_9c57_ddf3ec05cab7.slice/crio-5f2e91650662f1504259055a77af4d4fe443e71d7ff6d262de936d13f9b60c45 WatchSource:0}: Error finding container 5f2e91650662f1504259055a77af4d4fe443e71d7ff6d262de936d13f9b60c45: Status 404 returned error can't find the container with id 5f2e91650662f1504259055a77af4d4fe443e71d7ff6d262de936d13f9b60c45
Jul 23 15:00:18.742003 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.741929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:18.742003 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.741962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:18.742212 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.742076    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:18.742212 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.742149    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret podName:676860b9-b9bd-469c-9dcb-d05491dbcba2 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:19.742126652 +0000 UTC m=+4.456058574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret") pod "global-pull-secret-syncer-cr6qw" (UID: "676860b9-b9bd-469c-9dcb-d05491dbcba2") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:18.742212 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.742076    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:18.742378 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.742228    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs podName:5aaed50c-e7c8-4c83-9934-2e4c6e1580c8 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:19.742213158 +0000 UTC m=+4.456145075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs") pod "network-metrics-daemon-mflwc" (UID: "5aaed50c-e7c8-4c83-9934-2e4c6e1580c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:18.842809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:18.842767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:18.842985 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.842957    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:18.842985 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.842985    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:18.843233 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.842999    2575 projected.go:196] Error preparing data for projected volume kube-api-access-w2v5m for pod openshift-network-diagnostics/network-check-target-9wgr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:18.843233 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:18.843062    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m podName:84c23de0-11b9-4e9a-9978-c82b24aa9ea5 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:19.843043577 +0000 UTC m=+4.556975491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2v5m" (UniqueName: "kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m") pod "network-check-target-9wgr5" (UID: "84c23de0-11b9-4e9a-9978-c82b24aa9ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:19.034637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.034543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sqtn7" event={"ID":"526ec536-972b-4ef3-9912-ff9b52a57905","Type":"ContainerStarted","Data":"91aa64b8846f0dac014c51be47d8e547cdbc8fe038027678cc2eb00dd4148b35"}
Jul 23 15:00:19.037483 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.037453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"8b8dc7e3aa8a4a978b10499541c7ea097e22386d0973431a2360d676795e3f21"}
Jul 23 15:00:19.039503 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.039477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcmz4" event={"ID":"c09f591f-5743-4ced-ab17-11cc126d4894","Type":"ContainerStarted","Data":"8e42b9d630fc0a55baa90f3048fd8f73852c31510b021db2265b1f67088739bd"}
Jul 23 15:00:19.041580 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.041554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal" event={"ID":"e32e28f99e932c6f7c7566e18b3ac731","Type":"ContainerStarted","Data":"cb2e7129b6c11bb350b59abb0161d37e615eaa7adec668552110eb3fda3d166a"}
Jul 23 15:00:19.054195 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.054050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ss69" event={"ID":"b1057446-c158-4ba8-9c57-ddf3ec05cab7","Type":"ContainerStarted","Data":"5f2e91650662f1504259055a77af4d4fe443e71d7ff6d262de936d13f9b60c45"}
Jul 23 15:00:19.061269 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.061204    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnzhk" event={"ID":"3b271b25-7c76-47cf-aa1b-f42e1a9b704f","Type":"ContainerStarted","Data":"0bbe7b6a4cda537ab048c3fae0b220778805ed3c5df3f12c37229c3e6e1501ad"}
Jul 23 15:00:19.064292 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.064208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph" event={"ID":"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2","Type":"ContainerStarted","Data":"4b7ba83670f61762585e10aac6e924bc04f0903b5c3222ccc73b3414fd1d2da7"}
Jul 23 15:00:19.065888 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.065832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w44bd" event={"ID":"c41277be-6889-44cf-8587-f6b679eb5385","Type":"ContainerStarted","Data":"cbc25a3c19368744a0e214bce714fa363c9d1b5af5d5101a3b8e1db7b7c5a285"}
Jul 23 15:00:19.068882 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.068858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fs78" event={"ID":"6432ee70-0ca6-42a7-aab0-4837a8a0518f","Type":"ContainerStarted","Data":"b34129614888ee041fde00155b6b1a394deab75f2fdf634863ba30a03b941098"}
Jul 23 15:00:19.071581 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.071556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerStarted","Data":"6bd9cc99167fcbfa3b775581897f9775814740a4d33f8ff0a0d0e43ef0ba3ad6"}
Jul 23 15:00:19.084831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.084770    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:55:18 +0000 UTC" deadline="2028-04-09 19:56:24.033307934 +0000 UTC"
Jul 23 15:00:19.084831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.084830    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15028h56m4.948482312s"
Jul 23 15:00:19.761380 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.761339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:19.761569 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.761392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:19.761569 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.761521    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:19.761682 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.761586    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret podName:676860b9-b9bd-469c-9dcb-d05491dbcba2 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:21.761564498 +0000 UTC m=+6.475496417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret") pod "global-pull-secret-syncer-cr6qw" (UID: "676860b9-b9bd-469c-9dcb-d05491dbcba2") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:19.762045 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.762022    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:19.762124 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.762084    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs podName:5aaed50c-e7c8-4c83-9934-2e4c6e1580c8 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:21.762066342 +0000 UTC m=+6.475998263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs") pod "network-metrics-daemon-mflwc" (UID: "5aaed50c-e7c8-4c83-9934-2e4c6e1580c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.862995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.863133    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.863279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.863394    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.863417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:19.863468    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.863537    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.863618    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.863635    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.863648    2575 projected.go:196] Error preparing data for projected volume kube-api-access-w2v5m for pod openshift-network-diagnostics/network-check-target-9wgr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:19.863966 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:19.863691    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m podName:84c23de0-11b9-4e9a-9978-c82b24aa9ea5 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:21.863675509 +0000 UTC m=+6.577607439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2v5m" (UniqueName: "kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m") pod "network-check-target-9wgr5" (UID: "84c23de0-11b9-4e9a-9978-c82b24aa9ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:20.085511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:20.085424    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:55:18 +0000 UTC" deadline="2028-04-07 18:35:07.151136638 +0000 UTC"
Jul 23 15:00:20.085511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:20.085465    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14979h34m47.065676441s"
Jul 23 15:00:21.780328 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:21.780287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:21.780782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:21.780342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:21.780782 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.780474    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:21.780782 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.780540    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret podName:676860b9-b9bd-469c-9dcb-d05491dbcba2 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:25.780519981 +0000 UTC m=+10.494451900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret") pod "global-pull-secret-syncer-cr6qw" (UID: "676860b9-b9bd-469c-9dcb-d05491dbcba2") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:21.780961 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.780926    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:21.781011 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.780981    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs podName:5aaed50c-e7c8-4c83-9934-2e4c6e1580c8 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:25.780963498 +0000 UTC m=+10.494895418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs") pod "network-metrics-daemon-mflwc" (UID: "5aaed50c-e7c8-4c83-9934-2e4c6e1580c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:21.860752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:21.860265    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:21.860752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:21.860265    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:21.860752 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.860407    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:21.860752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:21.860442    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:21.860752 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.860538    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:21.860752 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.860629    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:21.881833 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:21.881196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:21.881833 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.881377    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:21.881833 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.881399    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:21.881833 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.881411    2575 projected.go:196] Error preparing data for projected volume kube-api-access-w2v5m for pod openshift-network-diagnostics/network-check-target-9wgr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:21.881833 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:21.881468    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m podName:84c23de0-11b9-4e9a-9978-c82b24aa9ea5 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:25.881449073 +0000 UTC m=+10.595380992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2v5m" (UniqueName: "kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m") pod "network-check-target-9wgr5" (UID: "84c23de0-11b9-4e9a-9978-c82b24aa9ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:23.862981 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:23.862942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:23.863520 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:23.863133    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:23.863520 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:23.863362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:23.863520 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:23.863482    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:23.863702 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:23.863540    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:23.863754 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:23.863703    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:25.814736 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:25.814689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:25.815215 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:25.814743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:25.815215 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.814856    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:25.815215 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.814880    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:25.815215 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.814924    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs podName:5aaed50c-e7c8-4c83-9934-2e4c6e1580c8 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:33.814903673 +0000 UTC m=+18.528835601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs") pod "network-metrics-daemon-mflwc" (UID: "5aaed50c-e7c8-4c83-9934-2e4c6e1580c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:25.815215 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.814944    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret podName:676860b9-b9bd-469c-9dcb-d05491dbcba2 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:33.814934307 +0000 UTC m=+18.528866227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret") pod "global-pull-secret-syncer-cr6qw" (UID: "676860b9-b9bd-469c-9dcb-d05491dbcba2") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:25.861339 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:25.860677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:25.861339 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.860793    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:25.861339 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:25.861156    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:25.861640 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.861417    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:25.861640 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:25.861451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:25.861640 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.861560    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:25.915400 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:25.915302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:25.915590 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.915571    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:25.915667 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.915599    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:25.915667 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.915613    2575 projected.go:196] Error preparing data for projected volume kube-api-access-w2v5m for pod openshift-network-diagnostics/network-check-target-9wgr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:25.915767 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:25.915673    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m podName:84c23de0-11b9-4e9a-9978-c82b24aa9ea5 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:33.915653405 +0000 UTC m=+18.629585320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2v5m" (UniqueName: "kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m") pod "network-check-target-9wgr5" (UID: "84c23de0-11b9-4e9a-9978-c82b24aa9ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:27.860321 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:27.860281    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:27.860321 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:27.860303    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:27.860805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:27.860322    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:27.860805 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:27.860439    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:27.860805 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:27.860530    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:27.860805 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:27.860617    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:29.860040 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:29.859957    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:29.860477 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:29.859962    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:29.860477 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:29.860073    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:29.860477 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:29.860186    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:29.860477 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:29.859971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:29.860477 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:29.860347    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:31.860286 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:31.860250    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:31.860745 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:31.860385    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:31.860745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:31.860251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:31.860745 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:31.860498    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:31.860745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:31.860523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:31.860745 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:31.860598    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:33.859812 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:33.859772    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:33.859812 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:33.859800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:33.860336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:33.859772    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:33.860336 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.859907    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:33.860336 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.860021    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:33.860336 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.860104    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:33.876723 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:33.876696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:33.876888 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:33.876730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:33.876888 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.876846    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:33.876888 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.876860    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:33.877018 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.876906    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret podName:676860b9-b9bd-469c-9dcb-d05491dbcba2 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:49.87688752 +0000 UTC m=+34.590819435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret") pod "global-pull-secret-syncer-cr6qw" (UID: "676860b9-b9bd-469c-9dcb-d05491dbcba2") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:33.877018 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.876925    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs podName:5aaed50c-e7c8-4c83-9934-2e4c6e1580c8 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:49.87691617 +0000 UTC m=+34.590848088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs") pod "network-metrics-daemon-mflwc" (UID: "5aaed50c-e7c8-4c83-9934-2e4c6e1580c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:33.977919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:33.977885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:33.978120 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.978102    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:33.978194 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.978126    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:33.978194 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.978141    2575 projected.go:196] Error preparing data for projected volume kube-api-access-w2v5m for pod openshift-network-diagnostics/network-check-target-9wgr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:33.978282 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:33.978218    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m podName:84c23de0-11b9-4e9a-9978-c82b24aa9ea5 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:49.978199109 +0000 UTC m=+34.692131029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2v5m" (UniqueName: "kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m") pod "network-check-target-9wgr5" (UID: "84c23de0-11b9-4e9a-9978-c82b24aa9ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:35.860204 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:35.859966    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:35.860699 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:35.860026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:35.860699 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:35.860296    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:35.860699 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:35.860044    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:35.860699 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:35.860376    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:35.860699 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:35.860461    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:37.860488 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:37.860313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:37.860488 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:37.860451    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:37.860942 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:37.860485    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:37.860942 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:37.860591    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:37.860942 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:37.860313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:37.860942 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:37.860918    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:38.127280 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:38.127047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"fff395d573edfcdf4d6a42b8941b3c516301bfbdec3bff4e5f4402d3d7ba29be"}
Jul 23 15:00:38.128979 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:38.128953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcmz4" event={"ID":"c09f591f-5743-4ced-ab17-11cc126d4894","Type":"ContainerStarted","Data":"836df7ca81cd38621bebe4e7764337564c2806617cc350471c8afe8e8f9ece77"}
Jul 23 15:00:38.130648 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:38.130620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal" event={"ID":"42e6b728db4eca8974e361f2558a6eea","Type":"ContainerStarted","Data":"0881e1c73d62275646958b06cfe63d0a47d5510e28be8597cf8b62ae87933e62"}
Jul 23 15:00:38.132040 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:38.132016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w44bd" event={"ID":"c41277be-6889-44cf-8587-f6b679eb5385","Type":"ContainerStarted","Data":"2acb51127a1a8ac091ef884594a1d00f3db474cfef29d38989610b0f0a0eff9e"}
Jul 23 15:00:38.157849 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:38.157790    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kcmz4" podStartSLOduration=3.813967512 podStartE2EDuration="23.157775441s" totalImagesPullingTime="19.343807929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:38.157498771 +0000 UTC m=+22.871430742" watchObservedRunningTime="2026-07-23 15:00:38.157775441 +0000 UTC m=+22.871707377"
Jul 23 15:00:38.173952 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:38.173909    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-206.ec2.internal" podStartSLOduration=21.173892505 podStartE2EDuration="21.173892505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:38.173555253 +0000 UTC m=+22.887487191" watchObservedRunningTime="2026-07-23 15:00:38.173892505 +0000 UTC m=+22.887824444"
Jul 23 15:00:38.196490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:38.196445    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w44bd" podStartSLOduration=2.857126032 podStartE2EDuration="22.19642926s" totalImagesPullingTime="19.339303228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:38.196053336 +0000 UTC m=+22.909985273" watchObservedRunningTime="2026-07-23 15:00:38.19642926 +0000 UTC m=+22.910361197"
Jul 23 15:00:39.135528 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.135445    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnzhk" event={"ID":"3b271b25-7c76-47cf-aa1b-f42e1a9b704f","Type":"ContainerStarted","Data":"ebfd06d92023bb16c4d0a56b8d1f8d455a958fa184a74a62aa594770c1d622cf"}
Jul 23 15:00:39.136917 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.136893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph" event={"ID":"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2","Type":"ContainerStarted","Data":"e1086b4f6806c40940e71fe8ba52551b3de3f4ddae3e90f5c779ea781ed62936"}
Jul 23 15:00:39.138181 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.138130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fs78" event={"ID":"6432ee70-0ca6-42a7-aab0-4837a8a0518f","Type":"ContainerStarted","Data":"a256a7e9a6e4dad026a9dd9b079a43938343c0e4d912336b7508680b14e50810"}
Jul 23 15:00:39.139552 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.139532    2575 generic.go:356] "Generic (PLEG): container finished" podID="9245f8f3-143a-4c8e-9489-9169a0c835ad" containerID="3f09e58a4b70daf10f50e72c3c6fdd042dbacd95bcab1bdecb713233a6889fa9" exitCode=0
Jul 23 15:00:39.139641 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.139600    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerDied","Data":"3f09e58a4b70daf10f50e72c3c6fdd042dbacd95bcab1bdecb713233a6889fa9"}
Jul 23 15:00:39.140918 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.140899    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sqtn7" event={"ID":"526ec536-972b-4ef3-9912-ff9b52a57905","Type":"ContainerStarted","Data":"12a219d87818c884972c9baca83758bb284490ba6837a2ff410c02713563dc13"}
Jul 23 15:00:39.144105 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.144068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"3b3884083dc9b9da59990ea10f22f4382b712e2c9be651076d79d3fa0c752b10"}
Jul 23 15:00:39.144243 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.144156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"588ea65f1a812f324feceee3e390583098689e091ba22fd46b4542e6536cd357"}
Jul 23 15:00:39.144243 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.144217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"a57299b354d42ce76e513507da29d241285c2453803737722f07379b58ce637f"}
Jul 23 15:00:39.144360 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.144270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"124670a2ab3d4f840772907a856edbd04aff5e48d7887eb77c451096f69fc523"}
Jul 23 15:00:39.144360 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.144311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"5f568c8d4b9b15acbb0cad1c869e75cc2cbf77b1f7c813e471ff00f6718bf02f"}
Jul 23 15:00:39.145523 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.145500    2575 generic.go:356] "Generic (PLEG): container finished" podID="e32e28f99e932c6f7c7566e18b3ac731" containerID="d6ec2f1555e713fae7b113d455bc3c1b46e9e69aa1e242e64edb5e4e6a4279cd" exitCode=0
Jul 23 15:00:39.145614 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.145594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal" event={"ID":"e32e28f99e932c6f7c7566e18b3ac731","Type":"ContainerDied","Data":"d6ec2f1555e713fae7b113d455bc3c1b46e9e69aa1e242e64edb5e4e6a4279cd"}
Jul 23 15:00:39.153721 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.153682    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nnzhk" podStartSLOduration=12.141578675 podStartE2EDuration="23.153668139s" totalImagesPullingTime="11.012089464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:39.153328213 +0000 UTC m=+23.867260148" watchObservedRunningTime="2026-07-23 15:00:39.153668139 +0000 UTC m=+23.867600075"
Jul 23 15:00:39.171949 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.171910    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7fs78" podStartSLOduration=9.423246817 podStartE2EDuration="24.171895408s" totalImagesPullingTime="14.748648591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:39.17142306 +0000 UTC m=+23.885354998" watchObservedRunningTime="2026-07-23 15:00:39.171895408 +0000 UTC m=+23.885827345"
Jul 23 15:00:39.195035 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.194749    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sqtn7" podStartSLOduration=3.9110247339999997 podStartE2EDuration="23.19472993s" totalImagesPullingTime="19.283705196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:39.194384054 +0000 UTC m=+23.908316034" watchObservedRunningTime="2026-07-23 15:00:39.19472993 +0000 UTC m=+23.908661867"
Jul 23 15:00:39.452558 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.452533    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 15:00:39.536607 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.536564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:39.860151 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.860070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:39.860355 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.860070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:39.860355 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:39.860221    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:39.860355 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:39.860257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:39.860501 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:39.860387    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:39.860501 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:39.860453    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:40.042488 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.042313    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T15:00:39.452551903Z","UUID":"40c42c36-8e6c-40a3-a5fc-f75f7f54a5b2","Handler":null,"Name":"","Endpoint":""}
Jul 23 15:00:40.044265 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.044241    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 15:00:40.044391 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.044287    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 15:00:40.150097 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.150001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal" event={"ID":"e32e28f99e932c6f7c7566e18b3ac731","Type":"ContainerStarted","Data":"b958f86da99336737848eabc5d11d25a42b78d7ff15517cbc657b35a635159cf"}
Jul 23 15:00:40.151771 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.151737    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ss69" event={"ID":"b1057446-c158-4ba8-9c57-ddf3ec05cab7","Type":"ContainerStarted","Data":"7a028d8fa559fff3a1a950a32a41c81b7e06599b7a21ead361a99d4192e274c7"}
Jul 23 15:00:40.153854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.153830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph" event={"ID":"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2","Type":"ContainerStarted","Data":"f88acdb83914c5329821f1d103d2b7de3fb2711d2e0404f3694992d316129ca7"}
Jul 23 15:00:40.166656 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.166594    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-206.ec2.internal" podStartSLOduration=23.166571657 podStartE2EDuration="23.166571657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:40.166391689 +0000 UTC m=+24.880323653" watchObservedRunningTime="2026-07-23 15:00:40.166571657 +0000 UTC m=+24.880503596"
Jul 23 15:00:40.182665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:40.182603    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6ss69" podStartSLOduration=4.883413166 podStartE2EDuration="24.182579195s" totalImagesPullingTime="19.299166029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:40.182465696 +0000 UTC m=+24.896397634" watchObservedRunningTime="2026-07-23 15:00:40.182579195 +0000 UTC m=+24.896511137"
Jul 23 15:00:41.158520 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:41.158418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph" event={"ID":"80ed9dd7-8567-4f74-b3ae-0359fa32cfb2","Type":"ContainerStarted","Data":"ef96a650df89b1f58a325818ecc372945f74248e08f150ca7649223184eefb44"}
Jul 23 15:00:41.162222 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:41.162185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"f058c1d23081e9302e3296a4daea59e4f27f0e701236a911f223f42ffbfc284a"}
Jul 23 15:00:41.182529 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:41.182477    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl9ph" podStartSLOduration=3.395435689 podStartE2EDuration="25.182460457s" totalImagesPullingTime="21.787024768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:41.182300806 +0000 UTC m=+25.896232771" watchObservedRunningTime="2026-07-23 15:00:41.182460457 +0000 UTC m=+25.896392394"
Jul 23 15:00:41.859881 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:41.859845    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:41.860100 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:41.859844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:41.860100 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:41.859962    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:41.860100 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:41.859844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:41.860291 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:41.860092    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:41.860291 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:41.860154    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:43.039038 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:43.039001    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:43.039824 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:43.039796    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:43.167467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:43.167434    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7fs78"
Jul 23 15:00:43.860582 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:43.860356    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:43.860582 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:43.860359    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:43.860760 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:43.860360    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:43.860760 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:43.860675    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:43.860830 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:43.860750    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:43.860872 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:43.860844    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:44.170780 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:44.170706    2575 generic.go:356] "Generic (PLEG): container finished" podID="9245f8f3-143a-4c8e-9489-9169a0c835ad" containerID="56b557f729360ea184d302e8e6fdc498df27c036ec4a18206e52452b3848ef68" exitCode=0
Jul 23 15:00:44.171409 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:44.170787    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerDied","Data":"56b557f729360ea184d302e8e6fdc498df27c036ec4a18206e52452b3848ef68"}
Jul 23 15:00:44.177679 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:44.177655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" event={"ID":"ad5522ce-1e49-4afd-91f3-c292f2cc691b","Type":"ContainerStarted","Data":"0e39cbb65688db58c1bc5c4ba8f3be908fa1bbbcc428b1544922646814c1cd0d"}
Jul 23 15:00:44.242846 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:44.242791    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p" podStartSLOduration=9.674204278 podStartE2EDuration="29.242774035s" totalImagesPullingTime="19.568569757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:44.242280392 +0000 UTC m=+28.956212343" watchObservedRunningTime="2026-07-23 15:00:44.242774035 +0000 UTC m=+28.956705971"
Jul 23 15:00:45.179569 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.179543    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 15:00:45.180044 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.179908    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:45.180044 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.179981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:45.195330 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.195303    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:45.195578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.195565    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:45.640943 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.640767    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mflwc"]
Jul 23 15:00:45.641084 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.641050    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:45.641160 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:45.641143    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:45.644702 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.644670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9wgr5"]
Jul 23 15:00:45.644884 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.644800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:45.644938 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:45.644913    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:45.645256 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.645236    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cr6qw"]
Jul 23 15:00:45.645331 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:45.645320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:45.645420 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:45.645404    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:46.092741 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:46.092701    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:00:46.860165 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:46.860081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:46.860511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:46.860229    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:46.860511 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:46.860241    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:46.860511 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:46.860312    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:46.860511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:46.860362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:46.860511 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:46.860431    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:47.185770 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:47.185737    2575 generic.go:356] "Generic (PLEG): container finished" podID="9245f8f3-143a-4c8e-9489-9169a0c835ad" containerID="3a1b09f7cdf01ba67b1ccd2f7b8bce04701c88ab07f4be723407bd362e308750" exitCode=0
Jul 23 15:00:47.185914 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:47.185817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerDied","Data":"3a1b09f7cdf01ba67b1ccd2f7b8bce04701c88ab07f4be723407bd362e308750"}
Jul 23 15:00:48.395531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:48.395464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:48.860437 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:48.860390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:48.860617 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:48.860390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:48.860617 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:48.860516    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:48.860617 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:48.860390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:48.860707 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:48.860672    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:48.860707 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:48.860578    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:48.932336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:48.932305    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:49.192279 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:49.192193    2575 generic.go:356] "Generic (PLEG): container finished" podID="9245f8f3-143a-4c8e-9489-9169a0c835ad" containerID="c765c7b55c8c6e983ec66e8e04baba14994d47adf4e9b4646551b02c5352dde6" exitCode=0
Jul 23 15:00:49.192279 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:49.192262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerDied","Data":"c765c7b55c8c6e983ec66e8e04baba14994d47adf4e9b4646551b02c5352dde6"}
Jul 23 15:00:49.892447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:49.892357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:49.892447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:49.892403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:49.892940 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.892523    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:49.892940 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.892542    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:49.892940 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.892594    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret podName:676860b9-b9bd-469c-9dcb-d05491dbcba2 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:21.892577401 +0000 UTC m=+66.606509331 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret") pod "global-pull-secret-syncer-cr6qw" (UID: "676860b9-b9bd-469c-9dcb-d05491dbcba2") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:49.892940 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.892616    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs podName:5aaed50c-e7c8-4c83-9934-2e4c6e1580c8 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:21.892605385 +0000 UTC m=+66.606537301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs") pod "network-metrics-daemon-mflwc" (UID: "5aaed50c-e7c8-4c83-9934-2e4c6e1580c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:49.993464 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:49.993422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:49.993631 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.993616    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:49.993706 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.993637    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:49.993706 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.993651    2575 projected.go:196] Error preparing data for projected volume kube-api-access-w2v5m for pod openshift-network-diagnostics/network-check-target-9wgr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:49.993797 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:49.993718    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m podName:84c23de0-11b9-4e9a-9978-c82b24aa9ea5 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:21.993698697 +0000 UTC m=+66.707630623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2v5m" (UniqueName: "kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m") pod "network-check-target-9wgr5" (UID: "84c23de0-11b9-4e9a-9978-c82b24aa9ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:50.860238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:50.860203    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:50.860238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:50.860233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:50.860566 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:50.860233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:50.860566 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:50.860333    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cr6qw" podUID="676860b9-b9bd-469c-9dcb-d05491dbcba2"
Jul 23 15:00:50.860566 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:50.860405    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mflwc" podUID="5aaed50c-e7c8-4c83-9934-2e4c6e1580c8"
Jul 23 15:00:50.860566 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:50.860493    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9wgr5" podUID="84c23de0-11b9-4e9a-9978-c82b24aa9ea5"
Jul 23 15:00:51.553708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.553679    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-206.ec2.internal" event="NodeReady"
Jul 23 15:00:51.554090 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.553837    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 15:00:51.603672 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.603585    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sjh4f"]
Jul 23 15:00:51.608097 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.608070    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gjctj"]
Jul 23 15:00:51.608287 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.608217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.611051 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.611026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:51.611820 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.611796    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 15:00:51.611944 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.611840    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-msfpg\""
Jul 23 15:00:51.611944 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.611804    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 15:00:51.613803 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.613783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4gdwl\""
Jul 23 15:00:51.613919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.613825    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 15:00:51.613919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.613876    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 15:00:51.613919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.613892    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 15:00:51.618518 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.618493    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjh4f"]
Jul 23 15:00:51.622133 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.622098    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gjctj"]
Jul 23 15:00:51.708518 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.708472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.708701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.708575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d338d08f-b835-442d-bd5a-4b13582ec231-cert\") pod \"ingress-canary-gjctj\" (UID: \"d338d08f-b835-442d-bd5a-4b13582ec231\") " pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:51.708701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.708611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8fx\" (UniqueName: \"kubernetes.io/projected/d338d08f-b835-442d-bd5a-4b13582ec231-kube-api-access-rr8fx\") pod \"ingress-canary-gjctj\" (UID: \"d338d08f-b835-442d-bd5a-4b13582ec231\") " pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:51.708701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.708638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adc6d4ae-cb83-4edc-a035-47563d5ca327-config-volume\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.708701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.708664    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dts8v\" (UniqueName: \"kubernetes.io/projected/adc6d4ae-cb83-4edc-a035-47563d5ca327-kube-api-access-dts8v\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.708701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.708684    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc6d4ae-cb83-4edc-a035-47563d5ca327-tmp-dir\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.809973 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.809759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8fx\" (UniqueName: \"kubernetes.io/projected/d338d08f-b835-442d-bd5a-4b13582ec231-kube-api-access-rr8fx\") pod \"ingress-canary-gjctj\" (UID: \"d338d08f-b835-442d-bd5a-4b13582ec231\") " pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:51.810162 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.809995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adc6d4ae-cb83-4edc-a035-47563d5ca327-config-volume\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.810162 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.810045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dts8v\" (UniqueName: \"kubernetes.io/projected/adc6d4ae-cb83-4edc-a035-47563d5ca327-kube-api-access-dts8v\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.810162 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.810077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc6d4ae-cb83-4edc-a035-47563d5ca327-tmp-dir\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.810162 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.810138    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.810406 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.810198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d338d08f-b835-442d-bd5a-4b13582ec231-cert\") pod \"ingress-canary-gjctj\" (UID: \"d338d08f-b835-442d-bd5a-4b13582ec231\") " pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:51.810406 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:51.810299    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:00:51.810406 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:51.810377    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls podName:adc6d4ae-cb83-4edc-a035-47563d5ca327 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:52.310354352 +0000 UTC m=+37.024286281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls") pod "dns-default-sjh4f" (UID: "adc6d4ae-cb83-4edc-a035-47563d5ca327") : secret "dns-default-metrics-tls" not found
Jul 23 15:00:51.810737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.810698    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc6d4ae-cb83-4edc-a035-47563d5ca327-tmp-dir\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.810957 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.810935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adc6d4ae-cb83-4edc-a035-47563d5ca327-config-volume\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.814708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.814683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d338d08f-b835-442d-bd5a-4b13582ec231-cert\") pod \"ingress-canary-gjctj\" (UID: \"d338d08f-b835-442d-bd5a-4b13582ec231\") " pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:51.820551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.820528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dts8v\" (UniqueName: \"kubernetes.io/projected/adc6d4ae-cb83-4edc-a035-47563d5ca327-kube-api-access-dts8v\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:51.820642 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.820576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8fx\" (UniqueName: \"kubernetes.io/projected/d338d08f-b835-442d-bd5a-4b13582ec231-kube-api-access-rr8fx\") pod \"ingress-canary-gjctj\" (UID: \"d338d08f-b835-442d-bd5a-4b13582ec231\") " pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:51.928857 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:51.928766    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gjctj"
Jul 23 15:00:52.092383 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.092348    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"]
Jul 23 15:00:52.095938 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.095914    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"
Jul 23 15:00:52.098519 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.098496    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mfxtk\""
Jul 23 15:00:52.098519 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.098510    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:00:52.098686 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.098669    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 15:00:52.106520 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.106494    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"]
Jul 23 15:00:52.200943 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.200862    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"]
Jul 23 15:00:52.204366 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.204334    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"]
Jul 23 15:00:52.204522 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.204469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.207802 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.207780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.208517 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.208498    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 15:00:52.208614 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.208504    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 15:00:52.208674 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.208663    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k8nqz\""
Jul 23 15:00:52.208727 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.208703    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:00:52.209195 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.209164    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 15:00:52.210579 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.210557    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 15:00:52.210933 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.210912    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 15:00:52.212945 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.212799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf8s6\" (UniqueName: \"kubernetes.io/projected/2113ed1c-891d-4d78-b3ed-2d20b721ea0a-kube-api-access-mf8s6\") pod \"volume-data-source-validator-78cf4c6f6-gtmkz\" (UID: \"2113ed1c-891d-4d78-b3ed-2d20b721ea0a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"
Jul 23 15:00:52.213075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.213007    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 15:00:52.213075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.213041    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 15:00:52.213222 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.213090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m657q\""
Jul 23 15:00:52.216139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.216118    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68f9d77c4b-q96gh"]
Jul 23 15:00:52.219362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.219333    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"]
Jul 23 15:00:52.219477 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.219457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.222629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.222611    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 15:00:52.222839 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.222825    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 15:00:52.223326 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.223311    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 15:00:52.223665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.223646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 15:00:52.223759 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.223694    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 15:00:52.223759 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.223697    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2nm7q\""
Jul 23 15:00:52.225524 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.225504    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 15:00:52.231616 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.231594    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"]
Jul 23 15:00:52.237738 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.237713    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68f9d77c4b-q96gh"]
Jul 23 15:00:52.313697 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf8s6\" (UniqueName: \"kubernetes.io/projected/2113ed1c-891d-4d78-b3ed-2d20b721ea0a-kube-api-access-mf8s6\") pod \"volume-data-source-validator-78cf4c6f6-gtmkz\" (UID: \"2113ed1c-891d-4d78-b3ed-2d20b721ea0a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"
Jul 23 15:00:52.313887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6975c61f-0c7a-49d4-a984-7fb8911baf40-config\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.313887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-stats-auth\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.313887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6975c61f-0c7a-49d4-a984-7fb8911baf40-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.313887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jxt\" (UniqueName: \"kubernetes.io/projected/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-kube-api-access-76jxt\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.313887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/59472e43-47e0-4e3e-bc7d-b013b1329e32-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.314123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.314123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.313970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fsp2\" (UniqueName: \"kubernetes.io/projected/59472e43-47e0-4e3e-bc7d-b013b1329e32-kube-api-access-4fsp2\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.314123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.314002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmfk\" (UniqueName: \"kubernetes.io/projected/6975c61f-0c7a-49d4-a984-7fb8911baf40-kube-api-access-qlmfk\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.314123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.314025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.314123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.314058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:52.314123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.314081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.314419 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.314133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-default-certificate\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.314419 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.314212    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:00:52.314419 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.314284    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls podName:adc6d4ae-cb83-4edc-a035-47563d5ca327 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:53.314260542 +0000 UTC m=+38.028192475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls") pod "dns-default-sjh4f" (UID: "adc6d4ae-cb83-4edc-a035-47563d5ca327") : secret "dns-default-metrics-tls" not found
Jul 23 15:00:52.327742 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.327708    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b87cc65c5-xj4qj"]
Jul 23 15:00:52.331313 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.331289    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.334348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.334326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf8s6\" (UniqueName: \"kubernetes.io/projected/2113ed1c-891d-4d78-b3ed-2d20b721ea0a-kube-api-access-mf8s6\") pod \"volume-data-source-validator-78cf4c6f6-gtmkz\" (UID: \"2113ed1c-891d-4d78-b3ed-2d20b721ea0a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"
Jul 23 15:00:52.335882 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.335855    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 15:00:52.336810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.336792    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qpm5s\""
Jul 23 15:00:52.337011 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.336993    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 15:00:52.337100 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.337028    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 15:00:52.350965 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.350944    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 15:00:52.357510 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.357480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b87cc65c5-xj4qj"]
Jul 23 15:00:52.396077 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.396042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:52.406530 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.406500    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"
Jul 23 15:00:52.415131 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6975c61f-0c7a-49d4-a984-7fb8911baf40-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.415274 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jxt\" (UniqueName: \"kubernetes.io/projected/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-kube-api-access-76jxt\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.415329 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-image-registry-private-configuration\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.415329 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/59472e43-47e0-4e3e-bc7d-b013b1329e32-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.415442 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.415442 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fsp2\" (UniqueName: \"kubernetes.io/projected/59472e43-47e0-4e3e-bc7d-b013b1329e32-kube-api-access-4fsp2\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.415532 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-certificates\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.415532 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-trusted-ca\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.415532 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-installation-pull-secrets\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.415661 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-bound-sa-token\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.415661 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.415545    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 15:00:52.415661 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmfk\" (UniqueName: \"kubernetes.io/projected/6975c61f-0c7a-49d4-a984-7fb8911baf40-kube-api-access-qlmfk\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.415661 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.415606    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:52.915584237 +0000 UTC m=+37.629516159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : secret "router-metrics-certs-default" not found
Jul 23 15:00:52.415661 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.415900 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.415900 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.415900 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92q4p\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-kube-api-access-92q4p\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.415900 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-default-certificate\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.415900 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.415868    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:52.416112 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.415911    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls podName:59472e43-47e0-4e3e-bc7d-b013b1329e32 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:52.915898246 +0000 UTC m=+37.629830176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5cr98" (UID: "59472e43-47e0-4e3e-bc7d-b013b1329e32") : secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:52.416112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.415985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6975c61f-0c7a-49d4-a984-7fb8911baf40-config\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.416112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.416011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-stats-auth\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.416112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.416037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-ca-trust-extracted\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.416112 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.416062    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:52.916044916 +0000 UTC m=+37.629976850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : configmap references non-existent config key: service-ca.crt
Jul 23 15:00:52.416389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.416113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/59472e43-47e0-4e3e-bc7d-b013b1329e32-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.416625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.416593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6975c61f-0c7a-49d4-a984-7fb8911baf40-config\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.418329 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.418309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6975c61f-0c7a-49d4-a984-7fb8911baf40-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.418619 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.418597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-stats-auth\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.418689 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.418612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-default-certificate\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.426582 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.426559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmfk\" (UniqueName: \"kubernetes.io/projected/6975c61f-0c7a-49d4-a984-7fb8911baf40-kube-api-access-qlmfk\") pod \"service-ca-operator-5bcbc94c78-7t4bd\" (UID: \"6975c61f-0c7a-49d4-a984-7fb8911baf40\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.426854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.426831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jxt\" (UniqueName: \"kubernetes.io/projected/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-kube-api-access-76jxt\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.427709 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.427685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fsp2\" (UniqueName: \"kubernetes.io/projected/59472e43-47e0-4e3e-bc7d-b013b1329e32-kube-api-access-4fsp2\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.472866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.472780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:52.516905 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.516867    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"
Jul 23 15:00:52.517117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-ca-trust-extracted\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-image-registry-private-configuration\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-certificates\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-trusted-ca\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517455 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-installation-pull-secrets\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517455 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-bound-sa-token\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517602 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-ca-trust-extracted\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517779 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517910 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92q4p\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-kube-api-access-92q4p\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.517910 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.517829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-certificates\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.518034 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.517914    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:00:52.518034 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.517936    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b87cc65c5-xj4qj: secret "image-registry-tls" not found
Jul 23 15:00:52.518034 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.518000    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls podName:4f3354ff-6bfe-4a27-981f-4cb4fd52592f nodeName:}" failed. No retries permitted until 2026-07-23 15:00:53.017981528 +0000 UTC m=+37.731913446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls") pod "image-registry-b87cc65c5-xj4qj" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f") : secret "image-registry-tls" not found
Jul 23 15:00:52.518488 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.518466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-trusted-ca\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.520103 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.520079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-image-registry-private-configuration\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.520222 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.520125    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-installation-pull-secrets\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.527211 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.527187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92q4p\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-kube-api-access-92q4p\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.527512 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.527489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-bound-sa-token\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:52.596601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.596554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:52.670364 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.670324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:52.860236 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.860131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:00:52.860413 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.860131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:00:52.860413 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.860131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:00:52.864842 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.864801    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:00:52.865108 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.865092    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:00:52.865868 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.865845    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:00:52.865868 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.865856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v5f82\""
Jul 23 15:00:52.866017 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.865917    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbp9q\""
Jul 23 15:00:52.866017 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.865855    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:00:52.921614 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.921582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.921804 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.921648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:52.921804 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:52.921691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:52.921804 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.921745    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 15:00:52.921936 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.921815    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:53.921796558 +0000 UTC m=+38.635728478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : secret "router-metrics-certs-default" not found
Jul 23 15:00:52.921936 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.921824    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:52.921936 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.921871    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:53.92185856 +0000 UTC m=+38.635790475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : configmap references non-existent config key: service-ca.crt
Jul 23 15:00:52.921936 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:52.921901    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls podName:59472e43-47e0-4e3e-bc7d-b013b1329e32 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:53.921881504 +0000 UTC m=+38.635813425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5cr98" (UID: "59472e43-47e0-4e3e-bc7d-b013b1329e32") : secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:53.023254 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.023201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:53.023469 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.023390    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:00:53.023469 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.023412    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b87cc65c5-xj4qj: secret "image-registry-tls" not found
Jul 23 15:00:53.023593 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.023477    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls podName:4f3354ff-6bfe-4a27-981f-4cb4fd52592f nodeName:}" failed. No retries permitted until 2026-07-23 15:00:54.023455801 +0000 UTC m=+38.737387738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls") pod "image-registry-b87cc65c5-xj4qj" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f") : secret "image-registry-tls" not found
Jul 23 15:00:53.153623 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.153380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:53.206366 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.206338    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gjctj"]
Jul 23 15:00:53.208507 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.208486    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz"]
Jul 23 15:00:53.210006 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:53.209974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd338d08f_b835_442d_bd5a_4b13582ec231.slice/crio-4c875d8028b01ae4f5b12fbfb5a19fd8374d5ffe3f7237af07fec85bc97e6f44 WatchSource:0}: Error finding container 4c875d8028b01ae4f5b12fbfb5a19fd8374d5ffe3f7237af07fec85bc97e6f44: Status 404 returned error can't find the container with id 4c875d8028b01ae4f5b12fbfb5a19fd8374d5ffe3f7237af07fec85bc97e6f44
Jul 23 15:00:53.211543 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:00:53.211430    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2113ed1c_891d_4d78_b3ed_2d20b721ea0a.slice/crio-bb65d1a0c3b4bef8b813d512415b34ba0a8f8af20ee1fd2f9e7cc7415e17ba5a WatchSource:0}: Error finding container bb65d1a0c3b4bef8b813d512415b34ba0a8f8af20ee1fd2f9e7cc7415e17ba5a: Status 404 returned error can't find the container with id bb65d1a0c3b4bef8b813d512415b34ba0a8f8af20ee1fd2f9e7cc7415e17ba5a
Jul 23 15:00:53.211939 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.211864    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd"]
Jul 23 15:00:53.267961 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.267934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:53.326482 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.326450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:53.326650 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.326627    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:00:53.326736 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.326717    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls podName:adc6d4ae-cb83-4edc-a035-47563d5ca327 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:55.326694471 +0000 UTC m=+40.040626407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls") pod "dns-default-sjh4f" (UID: "adc6d4ae-cb83-4edc-a035-47563d5ca327") : secret "dns-default-metrics-tls" not found
Jul 23 15:00:53.375305 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.375130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:53.665847 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.665761    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:53.735246 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.735215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:53.932471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.932386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:53.932471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.932453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:53.932703 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.932561    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:53.932703 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:53.932565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:53.932703 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.932626    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:55.932601288 +0000 UTC m=+40.646533222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : configmap references non-existent config key: service-ca.crt
Jul 23 15:00:53.932703 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.932657    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 15:00:53.932703 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.932678    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls podName:59472e43-47e0-4e3e-bc7d-b013b1329e32 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:55.932668326 +0000 UTC m=+40.646600247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5cr98" (UID: "59472e43-47e0-4e3e-bc7d-b013b1329e32") : secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:53.932983 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:53.932710    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:55.93269253 +0000 UTC m=+40.646624452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : secret "router-metrics-certs-default" not found
Jul 23 15:00:54.033331 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:54.033287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:54.033499 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:54.033487    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:00:54.033577 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:54.033504    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b87cc65c5-xj4qj: secret "image-registry-tls" not found
Jul 23 15:00:54.033577 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:54.033563    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls podName:4f3354ff-6bfe-4a27-981f-4cb4fd52592f nodeName:}" failed. No retries permitted until 2026-07-23 15:00:56.033543697 +0000 UTC m=+40.747475632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls") pod "image-registry-b87cc65c5-xj4qj" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f") : secret "image-registry-tls" not found
Jul 23 15:00:54.206910 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:54.206825    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gjctj" event={"ID":"d338d08f-b835-442d-bd5a-4b13582ec231","Type":"ContainerStarted","Data":"4c875d8028b01ae4f5b12fbfb5a19fd8374d5ffe3f7237af07fec85bc97e6f44"}
Jul 23 15:00:54.208441 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:54.208410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd" event={"ID":"6975c61f-0c7a-49d4-a984-7fb8911baf40","Type":"ContainerStarted","Data":"c9e81ebc8676d678982ce2e7534402aed7bbf3d72430615ba9932a75f2121b5b"}
Jul 23 15:00:54.214958 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:54.214920    2575 generic.go:356] "Generic (PLEG): container finished" podID="9245f8f3-143a-4c8e-9489-9169a0c835ad" containerID="dde0385133a231556f810bcd116a0919ab329f7ed3d0f4be22455b9b6a202ef2" exitCode=0
Jul 23 15:00:54.215126 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:54.215033    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerDied","Data":"dde0385133a231556f810bcd116a0919ab329f7ed3d0f4be22455b9b6a202ef2"}
Jul 23 15:00:54.224099 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:54.224026    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz" event={"ID":"2113ed1c-891d-4d78-b3ed-2d20b721ea0a","Type":"ContainerStarted","Data":"bb65d1a0c3b4bef8b813d512415b34ba0a8f8af20ee1fd2f9e7cc7415e17ba5a"}
Jul 23 15:00:55.130732 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:55.130695    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:55.230439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:55.230403    2575 generic.go:356] "Generic (PLEG): container finished" podID="9245f8f3-143a-4c8e-9489-9169a0c835ad" containerID="c8a260e3991630ee08f0e0e1105a6a4bc4ea07e53ed9726f59717ccf887e98ec" exitCode=0
Jul 23 15:00:55.230601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:55.230448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerDied","Data":"c8a260e3991630ee08f0e0e1105a6a4bc4ea07e53ed9726f59717ccf887e98ec"}
Jul 23 15:00:55.346727 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:55.346639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:55.346905 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:55.346788    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:00:55.346905 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:55.346838    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls podName:adc6d4ae-cb83-4edc-a035-47563d5ca327 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:59.346823682 +0000 UTC m=+44.060755597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls") pod "dns-default-sjh4f" (UID: "adc6d4ae-cb83-4edc-a035-47563d5ca327") : secret "dns-default-metrics-tls" not found
Jul 23 15:00:55.952050 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:55.952010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:55.952266 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:55.952083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:55.952266 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:55.952122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:55.952266 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:55.952161    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 15:00:55.952266 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:55.952239    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:55.952266 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:55.952254    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:59.952231645 +0000 UTC m=+44.666163583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : secret "router-metrics-certs-default" not found
Jul 23 15:00:55.952489 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:55.952279    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls podName:59472e43-47e0-4e3e-bc7d-b013b1329e32 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:59.952268833 +0000 UTC m=+44.666200751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5cr98" (UID: "59472e43-47e0-4e3e-bc7d-b013b1329e32") : secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:55.952489 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:55.952345    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:59.952328639 +0000 UTC m=+44.666260557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : configmap references non-existent config key: service-ca.crt
Jul 23 15:00:56.052873 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:56.052829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:00:56.053051 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:56.052957    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:00:56.053051 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:56.052978    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b87cc65c5-xj4qj: secret "image-registry-tls" not found
Jul 23 15:00:56.053051 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:56.053042    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls podName:4f3354ff-6bfe-4a27-981f-4cb4fd52592f nodeName:}" failed. No retries permitted until 2026-07-23 15:01:00.053028141 +0000 UTC m=+44.766960056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls") pod "image-registry-b87cc65c5-xj4qj" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f") : secret "image-registry-tls" not found
Jul 23 15:00:56.745994 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:56.745966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:56.848384 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:56.848351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:57.236995 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.236955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gjctj" event={"ID":"d338d08f-b835-442d-bd5a-4b13582ec231","Type":"ContainerStarted","Data":"98f0af186a5748dfb31913ffc89daeb014289f8d706e3033b084b97893129cd2"}
Jul 23 15:00:57.238591 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.238563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd" event={"ID":"6975c61f-0c7a-49d4-a984-7fb8911baf40","Type":"ContainerStarted","Data":"e4756425d20460d306a2640d3bce3c4786f83037682ac0a38a13b0458115ce24"}
Jul 23 15:00:57.242105 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.242080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9645x" event={"ID":"9245f8f3-143a-4c8e-9489-9169a0c835ad","Type":"ContainerStarted","Data":"77d6b1d5c30e545f35902d7a3d19af136ab04d34d5cd4c69448b2e8507398ac9"}
Jul 23 15:00:57.243541 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.243519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz" event={"ID":"2113ed1c-891d-4d78-b3ed-2d20b721ea0a","Type":"ContainerStarted","Data":"7014905cf0a8d21846e9defe10e2a3b0cdcea154df09ff7182abf6a93ea83101"}
Jul 23 15:00:57.256044 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.255991    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gjctj" podStartSLOduration=2.808817553 podStartE2EDuration="6.255973964s" totalImagesPullingTime="3.447156411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:57.255903602 +0000 UTC m=+41.969835540" watchObservedRunningTime="2026-07-23 15:00:57.255973964 +0000 UTC m=+41.969905902"
Jul 23 15:00:57.283976 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.283915    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9645x" podStartSLOduration=18.703591707 podStartE2EDuration="41.283893322s" totalImagesPullingTime="22.580301615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:57.282677114 +0000 UTC m=+41.996609063" watchObservedRunningTime="2026-07-23 15:00:57.283893322 +0000 UTC m=+41.997825260"
Jul 23 15:00:57.300687 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.300636    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd" podStartSLOduration=1.864259547 podStartE2EDuration="5.300618226s" totalImagesPullingTime="3.436358679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:57.30022678 +0000 UTC m=+42.014158740" watchObservedRunningTime="2026-07-23 15:00:57.300618226 +0000 UTC m=+42.014550188"
Jul 23 15:00:57.317584 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.317395    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gtmkz" podStartSLOduration=1.8967308 podStartE2EDuration="5.317378393s" totalImagesPullingTime="3.420647593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:57.317203877 +0000 UTC m=+42.031135833" watchObservedRunningTime="2026-07-23 15:00:57.317378393 +0000 UTC m=+42.031310329"
Jul 23 15:00:57.432035 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.431995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:57.514983 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:57.514896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:58.198594 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:58.198552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:58.293972 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:58.293941    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:58.617567 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:58.617488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:58.890796 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:58.890720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:58.990543 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:58.990500    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:59.379409 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.379371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:00:59.379796 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.379517    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:00:59.379796 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.379581    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls podName:adc6d4ae-cb83-4edc-a035-47563d5ca327 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.379564092 +0000 UTC m=+52.093496014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls") pod "dns-default-sjh4f" (UID: "adc6d4ae-cb83-4edc-a035-47563d5ca327") : secret "dns-default-metrics-tls" not found
Jul 23 15:00:59.634732 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.634640    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-25nrp"]
Jul 23 15:00:59.666098 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.666059    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25nrp"]
Jul 23 15:00:59.666273 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.666199    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.668960 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.668934    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 15:00:59.669235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.669220    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5f6ms\""
Jul 23 15:00:59.669311 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.669265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 15:00:59.670087 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.670073    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 15:00:59.670141 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.670126    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 15:00:59.782833 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.782793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/518251d8-a29e-4f66-b11d-fc68cde6ded0-data-volume\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.782985 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.782869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/518251d8-a29e-4f66-b11d-fc68cde6ded0-crio-socket\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.782985 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.782966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.783077 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.782997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spqp7\" (UniqueName: \"kubernetes.io/projected/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-api-access-spqp7\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.783077 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.783022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.791583 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.791553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:59.884008 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.883967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/518251d8-a29e-4f66-b11d-fc68cde6ded0-crio-socket\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.884008 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.884017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.884281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.884105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spqp7\" (UniqueName: \"kubernetes.io/projected/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-api-access-spqp7\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.884281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.884132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.884281 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.884182    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:00:59.884281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.884221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/518251d8-a29e-4f66-b11d-fc68cde6ded0-data-volume\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.884281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.884226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/518251d8-a29e-4f66-b11d-fc68cde6ded0-crio-socket\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.884281 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.884254    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:00.384233658 +0000 UTC m=+45.098165574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : configmap "kube-rbac-proxy" not found
Jul 23 15:00:59.884651 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.884336    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:00:59.884651 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.884385    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:00.384372068 +0000 UTC m=+45.098304002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:00:59.884651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.884564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/518251d8-a29e-4f66-b11d-fc68cde6ded0-data-volume\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.908227 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.908126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:00:59.910611 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.910587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spqp7\" (UniqueName: \"kubernetes.io/projected/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-api-access-spqp7\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:00:59.984814 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.984768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:59.985008 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.984848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:00:59.985008 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:00:59.984915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:00:59.985008 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.984846    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 15:00:59.985008 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.984990    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.98497008 +0000 UTC m=+52.698902010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : secret "router-metrics-certs-default" not found
Jul 23 15:00:59.985256 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.985017    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.984998549 +0000 UTC m=+52.698930485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : configmap references non-existent config key: service-ca.crt
Jul 23 15:00:59.985256 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.985038    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 15:00:59.985256 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:00:59.985076    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls podName:59472e43-47e0-4e3e-bc7d-b013b1329e32 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.985067405 +0000 UTC m=+52.698999320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5cr98" (UID: "59472e43-47e0-4e3e-bc7d-b013b1329e32") : secret "cluster-monitoring-operator-tls" not found
Jul 23 15:01:00.078064 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:00.078033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:00.086239 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:00.086211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:01:00.086378 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:00.086362    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:01:00.086378 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:00.086377    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b87cc65c5-xj4qj: secret "image-registry-tls" not found
Jul 23 15:01:00.086448 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:00.086435    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls podName:4f3354ff-6bfe-4a27-981f-4cb4fd52592f nodeName:}" failed. No retries permitted until 2026-07-23 15:01:08.086414643 +0000 UTC m=+52.800346563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls") pod "image-registry-b87cc65c5-xj4qj" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f") : secret "image-registry-tls" not found
Jul 23 15:01:00.150842 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:00.150811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:00.229945 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:00.229912    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:00.389006 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:00.388958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:00.389006 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:00.389004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:00.389502 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:00.389095    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:01:00.389502 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:00.389118    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:00.389502 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:00.389217    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:01.389162281 +0000 UTC m=+46.103094199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:00.389502 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:00.389236    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:01.389229651 +0000 UTC m=+46.103161569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : configmap "kube-rbac-proxy" not found
Jul 23 15:01:00.542670 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:00.542585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:01.395559 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:01.395513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:01.395559 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:01.395558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:01.396041 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:01.395642    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:01:01.396041 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:01.395723    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:03.395706954 +0000 UTC m=+48.109638869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : configmap "kube-rbac-proxy" not found
Jul 23 15:01:01.396041 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:01.395660    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:01.396041 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:01.395839    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:03.395817489 +0000 UTC m=+48.109749415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:01.404212 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:01.404188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:01.832800 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:01.832775    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sqtn7_526ec536-972b-4ef3-9912-ff9b52a57905/dns-node-resolver/0.log"
Jul 23 15:01:02.632048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:02.632018    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnzhk_3b271b25-7c76-47cf-aa1b-f42e1a9b704f/node-ca/0.log"
Jul 23 15:01:03.411111 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:03.411065    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:03.411111 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:03.411117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:03.411404 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:03.411209    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:01:03.411404 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:03.411290    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.41127302 +0000 UTC m=+52.125204935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : configmap "kube-rbac-proxy" not found
Jul 23 15:01:03.411404 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:03.411296    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:03.411404 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:03.411353    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.411332027 +0000 UTC m=+52.125263942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:03.631327 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:03.631293    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gjctj_d338d08f-b835-442d-bd5a-4b13582ec231/serve-healthcheck-canary/0.log"
Jul 23 15:01:04.015534 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:04.015494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:04.085413 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:04.085381    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:04.679672 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:04.679641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:05.142823 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:05.142749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:07.444745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.444709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:07.444745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.444748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:07.445262 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.444782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:01:07.445262 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:07.444873    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:01:07.445262 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:07.444885    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:07.445262 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:07.444925    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls podName:adc6d4ae-cb83-4edc-a035-47563d5ca327 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:23.444910763 +0000 UTC m=+68.158842678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls") pod "dns-default-sjh4f" (UID: "adc6d4ae-cb83-4edc-a035-47563d5ca327") : secret "dns-default-metrics-tls" not found
Jul 23 15:01:07.445262 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:07.444954    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls podName:518251d8-a29e-4f66-b11d-fc68cde6ded0 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:15.444936639 +0000 UTC m=+60.158868569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25nrp" (UID: "518251d8-a29e-4f66-b11d-fc68cde6ded0") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:07.445465 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.445371    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/518251d8-a29e-4f66-b11d-fc68cde6ded0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:07.551846 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.551812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:07.728345 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.728261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:07.828807 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.828772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:07.933237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:07.933203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:08.049759 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.049664    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:08.049937 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.049849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:08.050013 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.049938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:01:08.050013 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.049944    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 15:01:08.050097 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.050039    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:24.050022443 +0000 UTC m=+68.763954358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : configmap references non-existent config key: service-ca.crt
Jul 23 15:01:08.050097 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.050063    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs podName:9b79c5cf-b3e9-47d4-a22e-c6d2e0267556 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:24.050056674 +0000 UTC m=+68.763988588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs") pod "router-default-68f9d77c4b-q96gh" (UID: "9b79c5cf-b3e9-47d4-a22e-c6d2e0267556") : secret "router-metrics-certs-default" not found
Jul 23 15:01:08.050097 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.049994    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 15:01:08.050097 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.050087    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls podName:59472e43-47e0-4e3e-bc7d-b013b1329e32 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:24.050082688 +0000 UTC m=+68.764014602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-5cr98" (UID: "59472e43-47e0-4e3e-bc7d-b013b1329e32") : secret "cluster-monitoring-operator-tls" not found
Jul 23 15:01:08.096227 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.096192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:08.151070 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.151035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") pod \"image-registry-b87cc65c5-xj4qj\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") " pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:01:08.151239 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.151210    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:01:08.151239 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.151225    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b87cc65c5-xj4qj: secret "image-registry-tls" not found
Jul 23 15:01:08.151316 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:08.151281    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls podName:4f3354ff-6bfe-4a27-981f-4cb4fd52592f nodeName:}" failed. No retries permitted until 2026-07-23 15:01:24.151263383 +0000 UTC m=+68.865195318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls") pod "image-registry-b87cc65c5-xj4qj" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f") : secret "image-registry-tls" not found
Jul 23 15:01:08.216330 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.216295    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:08.461457 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.461425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:08.691814 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:08.691769    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:09.643457 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:09.643411    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:09.845859 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:09.845816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:10.372808 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:10.372774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:10.474341 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:10.474292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:10.844386 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:10.844331    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:11.243312 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:11.243276    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:11.344432 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:11.344394    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:11.455853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:11.455818    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:11.749306 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:11.749273    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:11.849877 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:11.849845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:11.916045 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:11.916012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:12.250530 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:12.250493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:12.433849 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:12.433816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:12.610434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:12.610352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:13.080007 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:13.079969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:13.490804 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:13.490771    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:13.589463 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:13.589431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:13.862846 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:13.862766    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:14.263763 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:14.263729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:14.473312 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:14.473259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:15.507475 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:15.507438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:15.509759 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:15.509740    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/518251d8-a29e-4f66-b11d-fc68cde6ded0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25nrp\" (UID: \"518251d8-a29e-4f66-b11d-fc68cde6ded0\") " pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:15.575317 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:15.575282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25nrp"
Jul 23 15:01:15.734086 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:15.734041    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25nrp"]
Jul 23 15:01:16.289787 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:16.289747    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25nrp" event={"ID":"518251d8-a29e-4f66-b11d-fc68cde6ded0","Type":"ContainerStarted","Data":"53d998fa88e801da649cb6ddd7f8905101ce26a14d503f08d3dd2ca8f8c4c55d"}
Jul 23 15:01:16.495160 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:16.495124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:16.600291 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:16.600216    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:17.062006 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:17.061965    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:17.197123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:17.197091    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqg6p"
Jul 23 15:01:17.449478 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:17.449447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:17.641545 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:17.641505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:17.738234 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:17.738127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:19.832899 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:19.832820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:19.887951 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:19.887915    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b87cc65c5-xj4qj"]
Jul 23 15:01:19.888223 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:01:19.888195    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj" podUID="4f3354ff-6bfe-4a27-981f-4cb4fd52592f"
Jul 23 15:01:19.925823 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:19.925789    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-995d89b9-wlw26"]
Jul 23 15:01:19.941443 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:19.941411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:19.947129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:19.947072    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:19.968771 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:19.968739    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-995d89b9-wlw26"]
Jul 23 15:01:20.053050 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be4d1260-b360-44ed-8262-392b19b005f3-trusted-ca\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.053250 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be4d1260-b360-44ed-8262-392b19b005f3-installation-pull-secrets\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.053250 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be4d1260-b360-44ed-8262-392b19b005f3-ca-trust-extracted\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.053250 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053154    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-registry-tls\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.053250 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053213    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be4d1260-b360-44ed-8262-392b19b005f3-registry-certificates\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.053424 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2xq8\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-kube-api-access-c2xq8\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.053424 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-bound-sa-token\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.053424 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.053354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be4d1260-b360-44ed-8262-392b19b005f3-image-registry-private-configuration\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.058302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.058273    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:20.153810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.153713    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:20.153810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.153748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be4d1260-b360-44ed-8262-392b19b005f3-installation-pull-secrets\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154032 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.153940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be4d1260-b360-44ed-8262-392b19b005f3-ca-trust-extracted\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154032 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.153983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-registry-tls\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154032 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.154009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be4d1260-b360-44ed-8262-392b19b005f3-registry-certificates\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154201 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.154035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2xq8\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-kube-api-access-c2xq8\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154201 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.154102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-bound-sa-token\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154201 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.154130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be4d1260-b360-44ed-8262-392b19b005f3-image-registry-private-configuration\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154358 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.154241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be4d1260-b360-44ed-8262-392b19b005f3-trusted-ca\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.154409 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.154354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be4d1260-b360-44ed-8262-392b19b005f3-ca-trust-extracted\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.155136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.155092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be4d1260-b360-44ed-8262-392b19b005f3-registry-certificates\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.155308 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.155225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be4d1260-b360-44ed-8262-392b19b005f3-trusted-ca\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.156814 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.156793    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-registry-tls\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.156932 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.156878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be4d1260-b360-44ed-8262-392b19b005f3-image-registry-private-configuration\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.156992 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.156961    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be4d1260-b360-44ed-8262-392b19b005f3-installation-pull-secrets\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.165519 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.165483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-bound-sa-token\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.166543 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.166518    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2xq8\" (UniqueName: \"kubernetes.io/projected/be4d1260-b360-44ed-8262-392b19b005f3-kube-api-access-c2xq8\") pod \"image-registry-995d89b9-wlw26\" (UID: \"be4d1260-b360-44ed-8262-392b19b005f3\") " pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.256365 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.256328    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qpm5s\""
Jul 23 15:01:20.256606 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.256569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:20.264094 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.264067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:20.300978 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.300941    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:01:20.309130 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.309108    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:01:20.333973 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.333940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:20.355723 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.355685    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-installation-pull-secrets\") pod \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") "
Jul 23 15:01:20.355723 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.355728    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-certificates\") pod \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") "
Jul 23 15:01:20.355971 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.355769    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-ca-trust-extracted\") pod \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") "
Jul 23 15:01:20.355971 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.355796    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-bound-sa-token\") pod \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") "
Jul 23 15:01:20.355971 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.355855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92q4p\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-kube-api-access-92q4p\") pod \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") "
Jul 23 15:01:20.355971 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.355887    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-image-registry-private-configuration\") pod \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") "
Jul 23 15:01:20.355971 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.355949    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-trusted-ca\") pod \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\" (UID: \"4f3354ff-6bfe-4a27-981f-4cb4fd52592f\") "
Jul 23 15:01:20.356268 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.356054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f3354ff-6bfe-4a27-981f-4cb4fd52592f" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:01:20.356268 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.356137    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f3354ff-6bfe-4a27-981f-4cb4fd52592f" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:01:20.356702 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.356390    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-certificates\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:20.356702 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.356406    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f3354ff-6bfe-4a27-981f-4cb4fd52592f" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:01:20.356702 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.356413    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-ca-trust-extracted\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:20.358807 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.358771    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f3354ff-6bfe-4a27-981f-4cb4fd52592f" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:01:20.359190 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.359143    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-kube-api-access-92q4p" (OuterVolumeSpecName: "kube-api-access-92q4p") pod "4f3354ff-6bfe-4a27-981f-4cb4fd52592f" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f"). InnerVolumeSpecName "kube-api-access-92q4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:01:20.359287 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.359187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f3354ff-6bfe-4a27-981f-4cb4fd52592f" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:01:20.359287 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.359225    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f3354ff-6bfe-4a27-981f-4cb4fd52592f" (UID: "4f3354ff-6bfe-4a27-981f-4cb4fd52592f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:01:20.457071 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.457040    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92q4p\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-kube-api-access-92q4p\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:20.457071 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.457070    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-image-registry-private-configuration\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:20.457390 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.457083    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-trusted-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:20.457390 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.457095    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-installation-pull-secrets\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:20.457390 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:20.457109    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-bound-sa-token\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:21.303630 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.303602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b87cc65c5-xj4qj"
Jul 23 15:01:21.340722 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.340693    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b87cc65c5-xj4qj"]
Jul 23 15:01:21.344089 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.344064    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b87cc65c5-xj4qj"]
Jul 23 15:01:21.466289 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.466256    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f3354ff-6bfe-4a27-981f-4cb4fd52592f-registry-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:01:21.863915 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.863883    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f3354ff-6bfe-4a27-981f-4cb4fd52592f" path="/var/lib/kubelet/pods/4f3354ff-6bfe-4a27-981f-4cb4fd52592f/volumes"
Jul 23 15:01:21.971413 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.971377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:01:21.971602 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.971421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:01:21.977958 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.974687    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:01:21.977958 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.975219    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:01:21.984156 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.984131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aaed50c-e7c8-4c83-9934-2e4c6e1580c8-metrics-certs\") pod \"network-metrics-daemon-mflwc\" (UID: \"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8\") " pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:01:21.984321 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.984306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/676860b9-b9bd-469c-9dcb-d05491dbcba2-original-pull-secret\") pod \"global-pull-secret-syncer-cr6qw\" (UID: \"676860b9-b9bd-469c-9dcb-d05491dbcba2\") " pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:01:21.987146 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.987125    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbp9q\""
Jul 23 15:01:21.995261 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:21.995233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mflwc"
Jul 23 15:01:22.072737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.072685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:01:22.077029 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.077003    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:01:22.089136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.089102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:01:22.097247 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.097219    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2v5m\" (UniqueName: \"kubernetes.io/projected/84c23de0-11b9-4e9a-9978-c82b24aa9ea5-kube-api-access-w2v5m\") pod \"network-check-target-9wgr5\" (UID: \"84c23de0-11b9-4e9a-9978-c82b24aa9ea5\") " pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:01:22.195489 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.195450    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mflwc"]
Jul 23 15:01:22.198135 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:22.198109    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaed50c_e7c8_4c83_9934_2e4c6e1580c8.slice/crio-578adc09a0d546db1fcaf0976a8ea2d2742cad1089b553fe2cd40ebad57ea045 WatchSource:0}: Error finding container 578adc09a0d546db1fcaf0976a8ea2d2742cad1089b553fe2cd40ebad57ea045: Status 404 returned error can't find the container with id 578adc09a0d546db1fcaf0976a8ea2d2742cad1089b553fe2cd40ebad57ea045
Jul 23 15:01:22.216747 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.216715    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-995d89b9-wlw26"]
Jul 23 15:01:22.219996 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:22.219963    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4d1260_b360_44ed_8262_392b19b005f3.slice/crio-c1f1c4055f664775c371d7ce62d9b628f09c5d1f9f93e88cac2e052b1dd04ad7 WatchSource:0}: Error finding container c1f1c4055f664775c371d7ce62d9b628f09c5d1f9f93e88cac2e052b1dd04ad7: Status 404 returned error can't find the container with id c1f1c4055f664775c371d7ce62d9b628f09c5d1f9f93e88cac2e052b1dd04ad7
Jul 23 15:01:22.275279 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.275259    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v5f82\""
Jul 23 15:01:22.280193 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.280159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cr6qw"
Jul 23 15:01:22.283828 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.283810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:01:22.308743 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.308519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25nrp" event={"ID":"518251d8-a29e-4f66-b11d-fc68cde6ded0","Type":"ContainerStarted","Data":"2cd7d18614522ce23ee834680bb1ad89e49973893deff338e9edbd699443a137"}
Jul 23 15:01:22.310115 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.309985    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mflwc" event={"ID":"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8","Type":"ContainerStarted","Data":"578adc09a0d546db1fcaf0976a8ea2d2742cad1089b553fe2cd40ebad57ea045"}
Jul 23 15:01:22.311789 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.311760    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-995d89b9-wlw26" event={"ID":"be4d1260-b360-44ed-8262-392b19b005f3","Type":"ContainerStarted","Data":"cae59151aadbff71ca14dd314e2406510045843faea4c5e8e77d82a3c05a9d11"}
Jul 23 15:01:22.311893 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.311810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-995d89b9-wlw26" event={"ID":"be4d1260-b360-44ed-8262-392b19b005f3","Type":"ContainerStarted","Data":"c1f1c4055f664775c371d7ce62d9b628f09c5d1f9f93e88cac2e052b1dd04ad7"}
Jul 23 15:01:22.311893 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.311863    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:22.334631 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.334322    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-995d89b9-wlw26" podStartSLOduration=3.334296274 podStartE2EDuration="3.334296274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:22.33227233 +0000 UTC m=+67.046204291" watchObservedRunningTime="2026-07-23 15:01:22.334296274 +0000 UTC m=+67.048228212"
Jul 23 15:01:22.423287 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.423202    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cr6qw"]
Jul 23 15:01:22.427246 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:22.427221    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676860b9_b9bd_469c_9dcb_d05491dbcba2.slice/crio-3d05fb445c63ab85f6fa98ce411e035bf5c8d1b07419de54ed83b3ecae1985f0 WatchSource:0}: Error finding container 3d05fb445c63ab85f6fa98ce411e035bf5c8d1b07419de54ed83b3ecae1985f0: Status 404 returned error can't find the container with id 3d05fb445c63ab85f6fa98ce411e035bf5c8d1b07419de54ed83b3ecae1985f0
Jul 23 15:01:22.437499 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:22.437473    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9wgr5"]
Jul 23 15:01:22.440867 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:22.440839    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c23de0_11b9_4e9a_9978_c82b24aa9ea5.slice/crio-c42ad37f4b0fc125467f8965b696c8f2791acff4350e705a3c644ef00ccc1ae2 WatchSource:0}: Error finding container c42ad37f4b0fc125467f8965b696c8f2791acff4350e705a3c644ef00ccc1ae2: Status 404 returned error can't find the container with id c42ad37f4b0fc125467f8965b696c8f2791acff4350e705a3c644ef00ccc1ae2
Jul 23 15:01:23.317329 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:23.317283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9wgr5" event={"ID":"84c23de0-11b9-4e9a-9978-c82b24aa9ea5","Type":"ContainerStarted","Data":"c42ad37f4b0fc125467f8965b696c8f2791acff4350e705a3c644ef00ccc1ae2"}
Jul 23 15:01:23.318722 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:23.318682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cr6qw" event={"ID":"676860b9-b9bd-469c-9dcb-d05491dbcba2","Type":"ContainerStarted","Data":"3d05fb445c63ab85f6fa98ce411e035bf5c8d1b07419de54ed83b3ecae1985f0"}
Jul 23 15:01:23.483342 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:23.483285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:01:23.486845 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:23.486819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adc6d4ae-cb83-4edc-a035-47563d5ca327-metrics-tls\") pod \"dns-default-sjh4f\" (UID: \"adc6d4ae-cb83-4edc-a035-47563d5ca327\") " pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:01:23.724952 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:23.724865    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-msfpg\""
Jul 23 15:01:23.732531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:23.732458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:01:23.919069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:23.918981    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjh4f"]
Jul 23 15:01:23.922345 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:23.922305    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc6d4ae_cb83_4edc_a035_47563d5ca327.slice/crio-71f6f3e15fce536294590bdafee9697a255a77c98e9de5b4926927b53593fa99 WatchSource:0}: Error finding container 71f6f3e15fce536294590bdafee9697a255a77c98e9de5b4926927b53593fa99: Status 404 returned error can't find the container with id 71f6f3e15fce536294590bdafee9697a255a77c98e9de5b4926927b53593fa99
Jul 23 15:01:24.088534 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.088485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:24.088709 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.088577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:01:24.088709 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.088630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:24.089326 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.089298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-service-ca-bundle\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:24.091603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.091553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b79c5cf-b3e9-47d4-a22e-c6d2e0267556-metrics-certs\") pod \"router-default-68f9d77c4b-q96gh\" (UID: \"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556\") " pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:24.091805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.091776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59472e43-47e0-4e3e-bc7d-b013b1329e32-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-5cr98\" (UID: \"59472e43-47e0-4e3e-bc7d-b013b1329e32\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:01:24.324244 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.324202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjh4f" event={"ID":"adc6d4ae-cb83-4edc-a035-47563d5ca327","Type":"ContainerStarted","Data":"71f6f3e15fce536294590bdafee9697a255a77c98e9de5b4926927b53593fa99"}
Jul 23 15:01:24.326360 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.326330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m657q\""
Jul 23 15:01:24.326499 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.326413    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mflwc" event={"ID":"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8","Type":"ContainerStarted","Data":"9ef2ba0fad557a6ef0caa793e251efc622167b272a22e039828ee36a84f33ecc"}
Jul 23 15:01:24.326499 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.326461    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mflwc" event={"ID":"5aaed50c-e7c8-4c83-9934-2e4c6e1580c8","Type":"ContainerStarted","Data":"6ea279ad79597a2b21e0ec48b64f3357d9fde5ff2b5870895b7bb6ef972b5b9b"}
Jul 23 15:01:24.331630 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.331597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2nm7q\""
Jul 23 15:01:24.333671 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.333650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"
Jul 23 15:01:24.339876 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.339847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:24.345338 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.345292    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mflwc" podStartSLOduration=67.903195736 podStartE2EDuration="1m9.345251147s" totalImagesPullingTime="1.442055411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:24.34455704 +0000 UTC m=+69.058488966" watchObservedRunningTime="2026-07-23 15:01:24.345251147 +0000 UTC m=+69.059183088"
Jul 23 15:01:24.481769 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.481696    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:24.518331 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.518206    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98"]
Jul 23 15:01:24.546002 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.545788    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68f9d77c4b-q96gh"]
Jul 23 15:01:24.549479 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:24.549443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:25.619003 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:25.618967    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59472e43_47e0_4e3e_bc7d_b013b1329e32.slice/crio-36c4b3a6e9f8b072f3df6bc47540c7c41a8123b2bcd030f774f1d9a6df24a592 WatchSource:0}: Error finding container 36c4b3a6e9f8b072f3df6bc47540c7c41a8123b2bcd030f774f1d9a6df24a592: Status 404 returned error can't find the container with id 36c4b3a6e9f8b072f3df6bc47540c7c41a8123b2bcd030f774f1d9a6df24a592
Jul 23 15:01:25.619775 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:25.619747    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b79c5cf_b3e9_47d4_a22e_c6d2e0267556.slice/crio-98baff357b0ed78e55a905743cd49c976cd63656d49331de9dbd9defb373adf6 WatchSource:0}: Error finding container 98baff357b0ed78e55a905743cd49c976cd63656d49331de9dbd9defb373adf6: Status 404 returned error can't find the container with id 98baff357b0ed78e55a905743cd49c976cd63656d49331de9dbd9defb373adf6
Jul 23 15:01:26.335288 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:26.335201    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68f9d77c4b-q96gh" event={"ID":"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556","Type":"ContainerStarted","Data":"98baff357b0ed78e55a905743cd49c976cd63656d49331de9dbd9defb373adf6"}
Jul 23 15:01:26.336472 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:26.336439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98" event={"ID":"59472e43-47e0-4e3e-bc7d-b013b1329e32","Type":"ContainerStarted","Data":"36c4b3a6e9f8b072f3df6bc47540c7c41a8123b2bcd030f774f1d9a6df24a592"}
Jul 23 15:01:26.394831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:26.394789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:26.496913 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:26.496872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:26.571578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:26.571534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:26.730897 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:26.730863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:26.787811 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:26.787776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:28.347049 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.347006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9wgr5" event={"ID":"84c23de0-11b9-4e9a-9978-c82b24aa9ea5","Type":"ContainerStarted","Data":"d648b05fcc175b33ea48168b757d2e3357d5512300750aa1364d23bee9affdaf"}
Jul 23 15:01:28.347656 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.347122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:01:28.349150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.349116    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cr6qw" event={"ID":"676860b9-b9bd-469c-9dcb-d05491dbcba2","Type":"ContainerStarted","Data":"0a60a35c159c8f160eadf175b89e0063f3c3b7e1d1ce1ec5566697264f28ecfd"}
Jul 23 15:01:28.352142 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.352111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjh4f" event={"ID":"adc6d4ae-cb83-4edc-a035-47563d5ca327","Type":"ContainerStarted","Data":"fb2825df8f1f9545ac4311fbc8b4e8835a7cd9d53f7b163e6b5e8a756a716e78"}
Jul 23 15:01:28.352278 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.352182    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjh4f" event={"ID":"adc6d4ae-cb83-4edc-a035-47563d5ca327","Type":"ContainerStarted","Data":"40606f082c86d2d83d144baa299bfb114d4de7d9386cdcaed5d1b927c2413e26"}
Jul 23 15:01:28.352278 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.352252    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:01:28.353974 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.353903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68f9d77c4b-q96gh" event={"ID":"9b79c5cf-b3e9-47d4-a22e-c6d2e0267556","Type":"ContainerStarted","Data":"8139ef7e533505ffd6608543bfdc9d7abf40a1b7a65837910f5f6f39da587771"}
Jul 23 15:01:28.390974 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.390913    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9wgr5" podStartSLOduration=67.324417754 podStartE2EDuration="1m12.390895735s" totalImagesPullingTime="5.066477981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:28.390299441 +0000 UTC m=+73.104231381" watchObservedRunningTime="2026-07-23 15:01:28.390895735 +0000 UTC m=+73.104827671"
Jul 23 15:01:28.450577 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.450511    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cr6qw" podStartSLOduration=67.357644585 podStartE2EDuration="1m12.450490669s" totalImagesPullingTime="5.092846084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:28.449385986 +0000 UTC m=+73.163317924" watchObservedRunningTime="2026-07-23 15:01:28.450490669 +0000 UTC m=+73.164422606"
Jul 23 15:01:28.493459 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.493397    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sjh4f" podStartSLOduration=33.907536337 podStartE2EDuration="37.493381957s" totalImagesPullingTime="3.58584562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:28.49310162 +0000 UTC m=+73.207033558" watchObservedRunningTime="2026-07-23 15:01:28.493381957 +0000 UTC m=+73.207313905"
Jul 23 15:01:28.523592 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.523534    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68f9d77c4b-q96gh" podStartSLOduration=36.523515672 podStartE2EDuration="36.523515672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:28.522151421 +0000 UTC m=+73.236083385" watchObservedRunningTime="2026-07-23 15:01:28.523515672 +0000 UTC m=+73.237447609"
Jul 23 15:01:28.579700 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.579657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:28.682775 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:28.682719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:29.340588 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:29.340546    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:29.343623 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:29.343601    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:29.358238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:29.358204    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:29.359504 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:29.359469    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68f9d77c4b-q96gh"
Jul 23 15:01:31.499076 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:31.499049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:31.596469 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:31.596441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:31.698653 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:31.698613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:31.842234 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:31.842129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:31.941394 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:31.941359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:32.055354 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:32.055307    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:32.370996 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:32.370960    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98" event={"ID":"59472e43-47e0-4e3e-bc7d-b013b1329e32","Type":"ContainerStarted","Data":"5cc786aca1aaca81304f0495b0ec361be88e109ee7b06016bb1e4b01b39d8fec"}
Jul 23 15:01:32.373024 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:32.372989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25nrp" event={"ID":"518251d8-a29e-4f66-b11d-fc68cde6ded0","Type":"ContainerStarted","Data":"c869de879898aa40d128eaf1cfaeffcb0dd4948f4450a4711cda832b883fcf85"}
Jul 23 15:01:32.398348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:32.398290    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-5cr98" podStartSLOduration=34.531549908 podStartE2EDuration="40.398269441s" totalImagesPullingTime="5.866719533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:32.397343434 +0000 UTC m=+77.111275397" watchObservedRunningTime="2026-07-23 15:01:32.398269441 +0000 UTC m=+77.112201380"
Jul 23 15:01:33.243956 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.243881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:33.338708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.338676    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f4495f488-sl6pd"]
Jul 23 15:01:33.342416 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.342382    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.347148 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.346919    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mbrg5\""
Jul 23 15:01:33.347148 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.346920    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 15:01:33.347148 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.346943    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 15:01:33.347148 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.346969    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 15:01:33.347148 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.346969    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 15:01:33.347528 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.347305    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 15:01:33.347528 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.347329    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 15:01:33.347528 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.347404    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 15:01:33.366125 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.366098    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4495f488-sl6pd"]
Jul 23 15:01:33.473519 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.473481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-config\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.473680 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.473546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlf7j\" (UniqueName: \"kubernetes.io/projected/afefcd3a-eafd-4efc-90b9-f6acb16515bc-kube-api-access-vlf7j\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.473680 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.473638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-oauth-config\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.473800 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.473681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-serving-cert\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.473861 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.473802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-service-ca\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.473861 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.473838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-oauth-serving-cert\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.534803 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.534722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:33.574795 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.574754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-service-ca\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.574969 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.574814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-oauth-serving-cert\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.574969 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.574856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-config\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.574969 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.574885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlf7j\" (UniqueName: \"kubernetes.io/projected/afefcd3a-eafd-4efc-90b9-f6acb16515bc-kube-api-access-vlf7j\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.574969 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.574917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-oauth-config\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.574969 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.574947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-serving-cert\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.575548 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.575523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-service-ca\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.575914 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.575887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-oauth-serving-cert\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.576018 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.575944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-config\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.578104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.578082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-oauth-config\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.578104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.578097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-serving-cert\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.586711 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.586683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlf7j\" (UniqueName: \"kubernetes.io/projected/afefcd3a-eafd-4efc-90b9-f6acb16515bc-kube-api-access-vlf7j\") pod \"console-7f4495f488-sl6pd\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") " pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:33.645767 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.645728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:33.653726 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:33.653691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:34.564902 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:34.564870    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:34.675608 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:34.675580    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:35.037259 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:35.037235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4495f488-sl6pd"]
Jul 23 15:01:35.039625 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:35.039602    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafefcd3a_eafd_4efc_90b9_f6acb16515bc.slice/crio-73e2dbc9c4aa75702d1984b0d57384ed12b567ce503b8f40e49d7e0d63fae08f WatchSource:0}: Error finding container 73e2dbc9c4aa75702d1984b0d57384ed12b567ce503b8f40e49d7e0d63fae08f: Status 404 returned error can't find the container with id 73e2dbc9c4aa75702d1984b0d57384ed12b567ce503b8f40e49d7e0d63fae08f
Jul 23 15:01:35.385986 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:35.385891    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25nrp" event={"ID":"518251d8-a29e-4f66-b11d-fc68cde6ded0","Type":"ContainerStarted","Data":"e3c00095c2bcdfe0d55d175c70daf89aea33dc6a7b04bb7258c4cfc8c079f45a"}
Jul 23 15:01:35.386956 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:35.386935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4495f488-sl6pd" event={"ID":"afefcd3a-eafd-4efc-90b9-f6acb16515bc","Type":"ContainerStarted","Data":"73e2dbc9c4aa75702d1984b0d57384ed12b567ce503b8f40e49d7e0d63fae08f"}
Jul 23 15:01:35.413217 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:35.413150    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-25nrp" podStartSLOduration=17.311792531 podStartE2EDuration="36.413133256s" totalImagesPullingTime="19.101340725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:35.412128051 +0000 UTC m=+80.126059988" watchObservedRunningTime="2026-07-23 15:01:35.413133256 +0000 UTC m=+80.127065193"
Jul 23 15:01:36.290495 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.290459    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:36.299387 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.299351    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84fc57d588-glbzq"]
Jul 23 15:01:36.302309 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.302280    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.311220 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.311188    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 15:01:36.313150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.313111    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fc57d588-glbzq"]
Jul 23 15:01:36.353461 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.353431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:36.396406 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.396374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nbmg\" (UniqueName: \"kubernetes.io/projected/e5cb0e4e-663b-403b-9772-f6b0562f3585-kube-api-access-9nbmg\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.396612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.396421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-oauth-serving-cert\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.396612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.396467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-config\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.396612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.396490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-trusted-ca-bundle\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.396612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.396567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-serving-cert\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.396792 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.396621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-oauth-config\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.396792 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.396648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-service-ca\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.497450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.497396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-serving-cert\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.497625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.497456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-oauth-config\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.497625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.497483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-service-ca\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.497625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.497545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nbmg\" (UniqueName: \"kubernetes.io/projected/e5cb0e4e-663b-403b-9772-f6b0562f3585-kube-api-access-9nbmg\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.497625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.497582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-oauth-serving-cert\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.497840 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.497628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-config\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.497840 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.497656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-trusted-ca-bundle\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.498908 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.498880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-service-ca\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.499036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.498902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-trusted-ca-bundle\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.499149 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.499126    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-oauth-serving-cert\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.499278 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.499259    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-config\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.500218 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.500191    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-oauth-config\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.500458 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.500440    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-serving-cert\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.507453 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.507414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nbmg\" (UniqueName: \"kubernetes.io/projected/e5cb0e4e-663b-403b-9772-f6b0562f3585-kube-api-access-9nbmg\") pod \"console-84fc57d588-glbzq\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") " pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.616296 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.616212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:36.710871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.710837    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:36.765491 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.765463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fc57d588-glbzq"]
Jul 23 15:01:36.787827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:36.787780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:37.219562 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:37.219522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:37.322184 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:37.322130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:37.781228 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:37.781190    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cb0e4e_663b_403b_9772_f6b0562f3585.slice/crio-7d2669eb214fe4560d3dd76e2471a806c020909166cc9e604e76430081b1dac1 WatchSource:0}: Error finding container 7d2669eb214fe4560d3dd76e2471a806c020909166cc9e604e76430081b1dac1: Status 404 returned error can't find the container with id 7d2669eb214fe4560d3dd76e2471a806c020909166cc9e604e76430081b1dac1
Jul 23 15:01:38.359825 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:38.359795    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sjh4f"
Jul 23 15:01:38.400429 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:38.400394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4495f488-sl6pd" event={"ID":"afefcd3a-eafd-4efc-90b9-f6acb16515bc","Type":"ContainerStarted","Data":"e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326"}
Jul 23 15:01:38.402333 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:38.402298    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fc57d588-glbzq" event={"ID":"e5cb0e4e-663b-403b-9772-f6b0562f3585","Type":"ContainerStarted","Data":"0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf"}
Jul 23 15:01:38.402471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:38.402352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fc57d588-glbzq" event={"ID":"e5cb0e4e-663b-403b-9772-f6b0562f3585","Type":"ContainerStarted","Data":"7d2669eb214fe4560d3dd76e2471a806c020909166cc9e604e76430081b1dac1"}
Jul 23 15:01:38.421060 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:38.421006    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f4495f488-sl6pd" podStartSLOduration=2.633233858 podStartE2EDuration="5.420988256s" totalImagesPullingTime="2.787754398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:38.420184505 +0000 UTC m=+83.134116464" watchObservedRunningTime="2026-07-23 15:01:38.420988256 +0000 UTC m=+83.134920251"
Jul 23 15:01:38.440456 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:38.440356    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84fc57d588-glbzq" podStartSLOduration=2.03207065 podStartE2EDuration="2.440337671s" totalImagesPullingTime="408.267021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:38.439272999 +0000 UTC m=+83.153204957" watchObservedRunningTime="2026-07-23 15:01:38.440337671 +0000 UTC m=+83.154269608"
Jul 23 15:01:38.493739 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:38.493710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:39.496649 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:39.496603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:41.731271 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:41.731239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:41.831907 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:41.831877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:43.323162 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:43.323130    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-995d89b9-wlw26"
Jul 23 15:01:43.576367 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:43.576287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:43.654531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:43.654494    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:43.654717 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:43.654549    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:43.660860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:43.660824    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:43.676380 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:43.676349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:43.777153 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:43.777122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:44.425919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:44.425891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:01:44.641525 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:44.641497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:46.112486 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.112445    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"]
Jul 23 15:01:46.116941 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.116916    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.119856 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.119831    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 15:01:46.121188 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.121146    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 15:01:46.121309 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.121146    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 15:01:46.121398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.121383    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7zg9m\""
Jul 23 15:01:46.126015 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.125994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"]
Jul 23 15:01:46.280867 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.280828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a36c505d-0409-4d97-bdd4-6f3cc70452d7-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.281056 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.280884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a36c505d-0409-4d97-bdd4-6f3cc70452d7-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.281056 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.280938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a36c505d-0409-4d97-bdd4-6f3cc70452d7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.281056 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.280960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbcx8\" (UniqueName: \"kubernetes.io/projected/a36c505d-0409-4d97-bdd4-6f3cc70452d7-kube-api-access-rbcx8\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.381766 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.381673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a36c505d-0409-4d97-bdd4-6f3cc70452d7-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.381766 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.381710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a36c505d-0409-4d97-bdd4-6f3cc70452d7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.381766 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.381731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbcx8\" (UniqueName: \"kubernetes.io/projected/a36c505d-0409-4d97-bdd4-6f3cc70452d7-kube-api-access-rbcx8\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.382033 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.381785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a36c505d-0409-4d97-bdd4-6f3cc70452d7-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.382427 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.382407    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a36c505d-0409-4d97-bdd4-6f3cc70452d7-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.384082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.384059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a36c505d-0409-4d97-bdd4-6f3cc70452d7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.384182 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.384143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a36c505d-0409-4d97-bdd4-6f3cc70452d7-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.391467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.391447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbcx8\" (UniqueName: \"kubernetes.io/projected/a36c505d-0409-4d97-bdd4-6f3cc70452d7-kube-api-access-rbcx8\") pod \"prometheus-operator-5945b5cfd-fglqm\" (UID: \"a36c505d-0409-4d97-bdd4-6f3cc70452d7\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.426261 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.426233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"
Jul 23 15:01:46.554558 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.554519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fglqm"]
Jul 23 15:01:46.557672 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:46.557638    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36c505d_0409_4d97_bdd4_6f3cc70452d7.slice/crio-831d7dc9120a420a07ad43bc15aba783fe8eec944435cd0540d99c330b265e0d WatchSource:0}: Error finding container 831d7dc9120a420a07ad43bc15aba783fe8eec944435cd0540d99c330b265e0d: Status 404 returned error can't find the container with id 831d7dc9120a420a07ad43bc15aba783fe8eec944435cd0540d99c330b265e0d
Jul 23 15:01:46.616710 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.616673    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:46.616882 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.616739    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:46.621657 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:46.621591    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:47.434055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:47.434012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm" event={"ID":"a36c505d-0409-4d97-bdd4-6f3cc70452d7","Type":"ContainerStarted","Data":"831d7dc9120a420a07ad43bc15aba783fe8eec944435cd0540d99c330b265e0d"}
Jul 23 15:01:47.438114 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:47.438090    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:01:47.492480 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:47.492447    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4495f488-sl6pd"]
Jul 23 15:01:47.497525 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:47.497478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:47.589489 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:47.589460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:47.690778 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:47.690689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:48.322630 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:48.322598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:48.427081 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:48.427047    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:50.958604 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:50.958520    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:51.453245 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:51.453206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm" event={"ID":"a36c505d-0409-4d97-bdd4-6f3cc70452d7","Type":"ContainerStarted","Data":"72e14a3266d2e92c6b6b810c02ec5431f527d191c4b2868cca9236acf4ee0693"}
Jul 23 15:01:51.453435 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:51.453284    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm" event={"ID":"a36c505d-0409-4d97-bdd4-6f3cc70452d7","Type":"ContainerStarted","Data":"fa70b20d33b8061ef51749a8d82e21fd2ec7546c75ada1cdfe1dc9d9b071db14"}
Jul 23 15:01:51.476773 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:51.476711    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fglqm" podStartSLOduration=1.3533326159999999 podStartE2EDuration="5.47669626s" totalImagesPullingTime="4.123363644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:51.475492034 +0000 UTC m=+96.189423996" watchObservedRunningTime="2026-07-23 15:01:51.47669626 +0000 UTC m=+96.190628196"
Jul 23 15:01:53.217449 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.217415    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:53.345462 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.345429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:53.449615 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.449558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:53.456807 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.456777    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"]
Jul 23 15:01:53.555981 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.555902    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:53.567492 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.567469    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"]
Jul 23 15:01:53.567590 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.567515    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nzds2"]
Jul 23 15:01:53.567628 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.567602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.570764 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.570736    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 15:01:53.570908 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.570787    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 15:01:53.570908 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.570792    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lh4gv\""
Jul 23 15:01:53.597798 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.597768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.601800 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.601780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 15:01:53.601951 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.601935    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wskx6\""
Jul 23 15:01:53.603010 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.602987    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 15:01:53.603136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.603018    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 15:01:53.667540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.667511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:53.737847 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.737808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71a24db4-5933-4e9e-8908-b199e5d1fa8b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.738021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.737858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-tls\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.737886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71a24db4-5933-4e9e-8908-b199e5d1fa8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.738021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.737938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a24db4-5933-4e9e-8908-b199e5d1fa8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.738021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.737970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl77q\" (UniqueName: \"kubernetes.io/projected/71a24db4-5933-4e9e-8908-b199e5d1fa8b-kube-api-access-cl77q\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.738021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.737993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-metrics-client-ca\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.738013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-root\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.738040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.738061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.738103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-wtmp\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.738123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-sys\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.738146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-textfile\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.738241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.738187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzc4\" (UniqueName: \"kubernetes.io/projected/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-kube-api-access-gwzc4\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.828351 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.828264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:53.839385 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-textfile\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.839468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzc4\" (UniqueName: \"kubernetes.io/projected/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-kube-api-access-gwzc4\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.839468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71a24db4-5933-4e9e-8908-b199e5d1fa8b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.839544 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-tls\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.839544 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71a24db4-5933-4e9e-8908-b199e5d1fa8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.839544 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a24db4-5933-4e9e-8908-b199e5d1fa8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.839696 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl77q\" (UniqueName: \"kubernetes.io/projected/71a24db4-5933-4e9e-8908-b199e5d1fa8b-kube-api-access-cl77q\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.839696 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-metrics-client-ca\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.839696 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-root\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.839696 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.839696 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-wtmp\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-sys\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-textfile\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-root\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839813    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-sys\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840336 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.839936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-wtmp\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840652 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.840346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-metrics-client-ca\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.840652 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.840346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71a24db4-5933-4e9e-8908-b199e5d1fa8b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.840652 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.840373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.842069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.842038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-tls\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.842216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.842128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71a24db4-5933-4e9e-8908-b199e5d1fa8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.842283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.842212    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.842340 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.842319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71a24db4-5933-4e9e-8908-b199e5d1fa8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.848706 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.848684    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl77q\" (UniqueName: \"kubernetes.io/projected/71a24db4-5933-4e9e-8908-b199e5d1fa8b-kube-api-access-cl77q\") pod \"openshift-state-metrics-79f6958cdf-j26mq\" (UID: \"71a24db4-5933-4e9e-8908-b199e5d1fa8b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.848823 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.848791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzc4\" (UniqueName: \"kubernetes.io/projected/f6bbcebf-0c11-4beb-ac5c-3df71864fa32-kube-api-access-gwzc4\") pod \"node-exporter-nzds2\" (UID: \"f6bbcebf-0c11-4beb-ac5c-3df71864fa32\") " pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.876567 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.876538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"
Jul 23 15:01:53.907729 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.907698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nzds2"
Jul 23 15:01:53.929363 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:53.929333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:53.954681 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:53.954647    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bbcebf_0c11_4beb_ac5c_3df71864fa32.slice/crio-03f2c9a480fbfeaeffad99993872225c63134e0b7fb90e5be5caabf0460e8a84 WatchSource:0}: Error finding container 03f2c9a480fbfeaeffad99993872225c63134e0b7fb90e5be5caabf0460e8a84: Status 404 returned error can't find the container with id 03f2c9a480fbfeaeffad99993872225c63134e0b7fb90e5be5caabf0460e8a84
Jul 23 15:01:54.065140 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.065104    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq"]
Jul 23 15:01:54.068305 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:54.068275    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a24db4_5933_4e9e_8908_b199e5d1fa8b.slice/crio-ca9329816d84c47019da77f88f5e9d56efbfcdc65124e5a47f64c446acdc0637 WatchSource:0}: Error finding container ca9329816d84c47019da77f88f5e9d56efbfcdc65124e5a47f64c446acdc0637: Status 404 returned error can't find the container with id ca9329816d84c47019da77f88f5e9d56efbfcdc65124e5a47f64c446acdc0637
Jul 23 15:01:54.328707 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.328681    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:54.467725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.467685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq" event={"ID":"71a24db4-5933-4e9e-8908-b199e5d1fa8b","Type":"ContainerStarted","Data":"b6842202036b25fe52342421b404f3aaca1f52d33a32c23291d54e168514b6fb"}
Jul 23 15:01:54.467890 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.467754    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq" event={"ID":"71a24db4-5933-4e9e-8908-b199e5d1fa8b","Type":"ContainerStarted","Data":"059a7bba22c435ba8ae1a214cb998f1a4e7b91baaa8280e11c5f3de33ef80a4d"}
Jul 23 15:01:54.467890 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.467782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq" event={"ID":"71a24db4-5933-4e9e-8908-b199e5d1fa8b","Type":"ContainerStarted","Data":"ca9329816d84c47019da77f88f5e9d56efbfcdc65124e5a47f64c446acdc0637"}
Jul 23 15:01:54.468753 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.468728    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzds2" event={"ID":"f6bbcebf-0c11-4beb-ac5c-3df71864fa32","Type":"ContainerStarted","Data":"03f2c9a480fbfeaeffad99993872225c63134e0b7fb90e5be5caabf0460e8a84"}
Jul 23 15:01:54.477389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.477358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:54.567134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.567097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:54.571682 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.571656    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:01:54.596508 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.596040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:01:54.596508 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.596229    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.599852 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.599556    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 15:01:54.599852 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.599631    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 15:01:54.599852 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.599626    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 15:01:54.599852 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.599568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 15:01:54.600150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.599979    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 15:01:54.600150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.599991    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 15:01:54.600290 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.600261    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wr8dx\""
Jul 23 15:01:54.600290 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.600279    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 15:01:54.600421 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.600400    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 15:01:54.607253 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.607231    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 15:01:54.746593 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746593 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746593 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-web-config\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-out\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.746860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.747067 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lszb\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-kube-api-access-5lszb\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.747067 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.747067 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.747067 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.746969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.783473 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.783437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:54.847746 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.847710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.847932 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.847876    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.847932 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.847915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.847954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-web-config\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848157 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848157 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-out\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848426 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lszb\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-kube-api-access-5lszb\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848426 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848426 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848813 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.848813 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.848739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.849961 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.849931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.851309 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.851256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-out\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.852610 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.852566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.853217 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.853194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-web-config\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.854344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.854320    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.854681 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.854643    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.854815 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.854759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.854886 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.854857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.855345 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.855312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.856314 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.856293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.858537 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.858517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lszb\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-kube-api-access-5lszb\") pod \"alertmanager-main-0\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:54.912769 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:54.912731    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:01:55.210541 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:55.210505    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:01:55.213933 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:55.213906    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c1b3fe_ab19_4728_bbaf_4649d3af551a.slice/crio-11148b5f78b96377cbbe850986ad1f21f785b64b227ff3a6a338f8ee7fed0791 WatchSource:0}: Error finding container 11148b5f78b96377cbbe850986ad1f21f785b64b227ff3a6a338f8ee7fed0791: Status 404 returned error can't find the container with id 11148b5f78b96377cbbe850986ad1f21f785b64b227ff3a6a338f8ee7fed0791
Jul 23 15:01:55.475440 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:55.475394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerStarted","Data":"11148b5f78b96377cbbe850986ad1f21f785b64b227ff3a6a338f8ee7fed0791"}
Jul 23 15:01:56.481216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:56.481153    2575 generic.go:356] "Generic (PLEG): container finished" podID="f6bbcebf-0c11-4beb-ac5c-3df71864fa32" containerID="387798541ac28219fc67e8ba8fccd52be568849b4a228eacca553d97eb1039b7" exitCode=0
Jul 23 15:01:56.481216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:56.481204    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzds2" event={"ID":"f6bbcebf-0c11-4beb-ac5c-3df71864fa32","Type":"ContainerDied","Data":"387798541ac28219fc67e8ba8fccd52be568849b4a228eacca553d97eb1039b7"}
Jul 23 15:01:56.524885 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:56.524829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:56.590385 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:56.590349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:56.788952 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:56.788922    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:56.890704 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:56.890658    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:57.487122 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:57.487081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq" event={"ID":"71a24db4-5933-4e9e-8908-b199e5d1fa8b","Type":"ContainerStarted","Data":"8a0ce7b7d8e918c6fdf3b1b5f8286f741ca1a5d76d2fd329094752ef5c3f78df"}
Jul 23 15:01:57.488537 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:57.488511    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerID="5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd" exitCode=0
Jul 23 15:01:57.488682 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:57.488599    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd"}
Jul 23 15:01:57.490788 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:57.490766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzds2" event={"ID":"f6bbcebf-0c11-4beb-ac5c-3df71864fa32","Type":"ContainerStarted","Data":"1e475206f11fdb4e84e4355a8152c465e6464d84a1a6e5d510dc61a93897dc8d"}
Jul 23 15:01:57.490861 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:57.490818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzds2" event={"ID":"f6bbcebf-0c11-4beb-ac5c-3df71864fa32","Type":"ContainerStarted","Data":"e1ce37a8f88e2e08f35267ce4dc00c5061c3e6dd8540f8396d43cbc8b72bdd7f"}
Jul 23 15:01:57.510059 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:57.509903    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j26mq" podStartSLOduration=2.240802422 podStartE2EDuration="4.509884956s" totalImagesPullingTime="2.269082534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:57.509559513 +0000 UTC m=+102.223491440" watchObservedRunningTime="2026-07-23 15:01:57.509884956 +0000 UTC m=+102.223816892"
Jul 23 15:01:57.540091 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:57.540039    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nzds2" podStartSLOduration=2.9737423610000002 podStartE2EDuration="4.540022915s" totalImagesPullingTime="1.450397188s" totalInitContainerRuntime="115.883366ms" isStatefulPod=true podCreationTimestamp="2026-07-23 15:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:57.539456934 +0000 UTC m=+102.253388906" watchObservedRunningTime="2026-07-23 15:01:57.540022915 +0000 UTC m=+102.253954853"
Jul 23 15:01:58.287892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.285195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:58.291289 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.291260    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"]
Jul 23 15:01:58.311500 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.311459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"]
Jul 23 15:01:58.311672 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.311576    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.314907 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.314884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 15:01:58.315068 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.314888    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cx2cl\""
Jul 23 15:01:58.315692 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.315669    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78798c8c7-gvhp5"]
Jul 23 15:01:58.331604 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.331575    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78798c8c7-gvhp5"]
Jul 23 15:01:58.331785 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.331691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.361694 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.361664    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:58.378368 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-trusted-ca-bundle\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.378560 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-service-ca\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.378560 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzx5\" (UniqueName: \"kubernetes.io/projected/6d79b1db-15cd-477b-9a34-794898d6e688-kube-api-access-mrzx5\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.378560 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/50e9f44a-2279-42fa-9ad5-43bc7e82dfc7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-ptkrg\" (UID: \"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.378560 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-oauth-config\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.378560 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-console-config\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.378799 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6cbg\" (UniqueName: \"kubernetes.io/projected/50e9f44a-2279-42fa-9ad5-43bc7e82dfc7-kube-api-access-r6cbg\") pod \"monitoring-plugin-7b7b7bc8bf-ptkrg\" (UID: \"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.378799 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-serving-cert\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.378799 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.378674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-oauth-serving-cert\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.456201 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.456136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:58.479369 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-trusted-ca-bundle\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.479557 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-service-ca\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.479557 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrzx5\" (UniqueName: \"kubernetes.io/projected/6d79b1db-15cd-477b-9a34-794898d6e688-kube-api-access-mrzx5\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.479557 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/50e9f44a-2279-42fa-9ad5-43bc7e82dfc7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-ptkrg\" (UID: \"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.479557 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-oauth-config\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.479557 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-console-config\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.479813 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6cbg\" (UniqueName: \"kubernetes.io/projected/50e9f44a-2279-42fa-9ad5-43bc7e82dfc7-kube-api-access-r6cbg\") pod \"monitoring-plugin-7b7b7bc8bf-ptkrg\" (UID: \"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.479813 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-serving-cert\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.479813 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.479770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-oauth-serving-cert\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.480325 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.480300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-service-ca\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.480325 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.480318    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-console-config\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.480508 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.480386    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-trusted-ca-bundle\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.480508 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.480478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-oauth-serving-cert\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.482110 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.482054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-oauth-config\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.482235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.482215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/50e9f44a-2279-42fa-9ad5-43bc7e82dfc7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-ptkrg\" (UID: \"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.482355 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.482337    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-serving-cert\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.489075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.489049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6cbg\" (UniqueName: \"kubernetes.io/projected/50e9f44a-2279-42fa-9ad5-43bc7e82dfc7-kube-api-access-r6cbg\") pod \"monitoring-plugin-7b7b7bc8bf-ptkrg\" (UID: \"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.489410 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.489343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrzx5\" (UniqueName: \"kubernetes.io/projected/6d79b1db-15cd-477b-9a34-794898d6e688-kube-api-access-mrzx5\") pod \"console-78798c8c7-gvhp5\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") " pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.556498 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.556414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:58.622624 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.622587    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:01:58.641690 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.641667    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:01:58.778003 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.777973    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"]
Jul 23 15:01:58.780355 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:58.780314    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e9f44a_2279_42fa_9ad5_43bc7e82dfc7.slice/crio-fb4ee64c32d9601dda90729497608f34692292971c5e9164ef98fbdf87ab5de0 WatchSource:0}: Error finding container fb4ee64c32d9601dda90729497608f34692292971c5e9164ef98fbdf87ab5de0: Status 404 returned error can't find the container with id fb4ee64c32d9601dda90729497608f34692292971c5e9164ef98fbdf87ab5de0
Jul 23 15:01:58.800470 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:58.800444    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78798c8c7-gvhp5"]
Jul 23 15:01:58.802627 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:01:58.802605    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d79b1db_15cd_477b_9a34_794898d6e688.slice/crio-eab1d787d7a554042f7cec9462bf71f91d4de5e85b253bd3e40edf79382b6fea WatchSource:0}: Error finding container eab1d787d7a554042f7cec9462bf71f91d4de5e85b253bd3e40edf79382b6fea: Status 404 returned error can't find the container with id eab1d787d7a554042f7cec9462bf71f91d4de5e85b253bd3e40edf79382b6fea
Jul 23 15:01:59.148914 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.148835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:59.249772 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.249736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:01:59.360797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.360773    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9wgr5"
Jul 23 15:01:59.499602 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.499568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78798c8c7-gvhp5" event={"ID":"6d79b1db-15cd-477b-9a34-794898d6e688","Type":"ContainerStarted","Data":"7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91"}
Jul 23 15:01:59.499994 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.499627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78798c8c7-gvhp5" event={"ID":"6d79b1db-15cd-477b-9a34-794898d6e688","Type":"ContainerStarted","Data":"eab1d787d7a554042f7cec9462bf71f91d4de5e85b253bd3e40edf79382b6fea"}
Jul 23 15:01:59.500757 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.500736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg" event={"ID":"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7","Type":"ContainerStarted","Data":"fb4ee64c32d9601dda90729497608f34692292971c5e9164ef98fbdf87ab5de0"}
Jul 23 15:01:59.524441 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.523009    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78798c8c7-gvhp5" podStartSLOduration=1.522984089 podStartE2EDuration="1.522984089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:59.521067876 +0000 UTC m=+104.234999828" watchObservedRunningTime="2026-07-23 15:01:59.522984089 +0000 UTC m=+104.236916028"
Jul 23 15:01:59.748039 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:01:59.748005    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:01.511998 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:01.511906    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg" event={"ID":"50e9f44a-2279-42fa-9ad5-43bc7e82dfc7","Type":"ContainerStarted","Data":"471be5ecf2f1ddcbcdefdde1eee75ced9f906866f7bf11a3b7564f05687e5e13"}
Jul 23 15:02:01.512471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:01.512139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:02:01.517650 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:01.517628    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg"
Jul 23 15:02:01.530295 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:01.530237    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-ptkrg" podStartSLOduration=1.100017881 podStartE2EDuration="3.530220678s" totalImagesPullingTime="2.430202797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:02:01.529949988 +0000 UTC m=+106.243881946" watchObservedRunningTime="2026-07-23 15:02:01.530220678 +0000 UTC m=+106.244152614"
Jul 23 15:02:02.620226 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:02.620159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:02.720677 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:02.720647    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:02.823642 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:02.823609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:03.522403 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.522367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerStarted","Data":"e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8"}
Jul 23 15:02:03.522584 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.522445    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerStarted","Data":"6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435"}
Jul 23 15:02:03.522584 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.522478    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerStarted","Data":"2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b"}
Jul 23 15:02:03.522584 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.522505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerStarted","Data":"861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba"}
Jul 23 15:02:03.522584 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.522536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerStarted","Data":"b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03"}
Jul 23 15:02:03.523742 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.523718    2575 generic.go:356] "Generic (PLEG): container finished" podID="6975c61f-0c7a-49d4-a984-7fb8911baf40" containerID="e4756425d20460d306a2640d3bce3c4786f83037682ac0a38a13b0458115ce24" exitCode=0
Jul 23 15:02:03.523862 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.523791    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd" event={"ID":"6975c61f-0c7a-49d4-a984-7fb8911baf40","Type":"ContainerDied","Data":"e4756425d20460d306a2640d3bce3c4786f83037682ac0a38a13b0458115ce24"}
Jul 23 15:02:03.524075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:03.524059    2575 scope.go:117] "RemoveContainer" containerID="e4756425d20460d306a2640d3bce3c4786f83037682ac0a38a13b0458115ce24"
Jul 23 15:02:04.532036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:04.531954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerStarted","Data":"9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11"}
Jul 23 15:02:04.533827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:04.533804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7t4bd" event={"ID":"6975c61f-0c7a-49d4-a984-7fb8911baf40","Type":"ContainerStarted","Data":"a5a1e6d5f38c9c06f8a3f5718e5313042b174b811880a4b010ced0349f91446d"}
Jul 23 15:02:04.564244 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:04.564196    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6830530870000002 podStartE2EDuration="10.564155668s" totalImagesPullingTime="7.852680841s" totalInitContainerRuntime="28.42174ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:02:04.562009258 +0000 UTC m=+109.275941197" watchObservedRunningTime="2026-07-23 15:02:04.564155668 +0000 UTC m=+109.278087606"
Jul 23 15:02:07.933533 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:07.933470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:08.642248 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:08.642200    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:02:08.642436 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:08.642275    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:02:08.646925 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:08.646900    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:02:09.557217 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:09.557190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:02:09.606899 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:09.606865    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84fc57d588-glbzq"]
Jul 23 15:02:09.716520 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:09.716492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:09.818879 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:09.818802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:09.927558 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:09.927524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:10.022041 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:10.022009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:10.442102 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:10.442068    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:10.543511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:10.543465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:12.215436 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.215402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:12.280367 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.280328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:02:12.513129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.513039    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f4495f488-sl6pd" podUID="afefcd3a-eafd-4efc-90b9-f6acb16515bc" containerName="console" containerID="cri-o://e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326" gracePeriod=15
Jul 23 15:02:12.752605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.752581    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:02:12.802734 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.802643    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlf7j\" (UniqueName: \"kubernetes.io/projected/afefcd3a-eafd-4efc-90b9-f6acb16515bc-kube-api-access-vlf7j\") pod \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") "
Jul 23 15:02:12.802734 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.802698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-service-ca\") pod \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") "
Jul 23 15:02:12.802940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.802745    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-serving-cert\") pod \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") "
Jul 23 15:02:12.802940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.802809    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-config\") pod \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") "
Jul 23 15:02:12.802940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.802864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-oauth-config\") pod \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") "
Jul 23 15:02:12.802940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.802888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-oauth-serving-cert\") pod \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\" (UID: \"afefcd3a-eafd-4efc-90b9-f6acb16515bc\") "
Jul 23 15:02:12.803212 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.803142    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "afefcd3a-eafd-4efc-90b9-f6acb16515bc" (UID: "afefcd3a-eafd-4efc-90b9-f6acb16515bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:02:12.803351 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.803218    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-config" (OuterVolumeSpecName: "console-config") pod "afefcd3a-eafd-4efc-90b9-f6acb16515bc" (UID: "afefcd3a-eafd-4efc-90b9-f6acb16515bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:02:12.803431 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.803410    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "afefcd3a-eafd-4efc-90b9-f6acb16515bc" (UID: "afefcd3a-eafd-4efc-90b9-f6acb16515bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:02:12.805047 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.805019    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "afefcd3a-eafd-4efc-90b9-f6acb16515bc" (UID: "afefcd3a-eafd-4efc-90b9-f6acb16515bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:02:12.805134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.805048    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "afefcd3a-eafd-4efc-90b9-f6acb16515bc" (UID: "afefcd3a-eafd-4efc-90b9-f6acb16515bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:02:12.805134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.805090    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afefcd3a-eafd-4efc-90b9-f6acb16515bc-kube-api-access-vlf7j" (OuterVolumeSpecName: "kube-api-access-vlf7j") pod "afefcd3a-eafd-4efc-90b9-f6acb16515bc" (UID: "afefcd3a-eafd-4efc-90b9-f6acb16515bc"). InnerVolumeSpecName "kube-api-access-vlf7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:02:12.903853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.903807    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlf7j\" (UniqueName: \"kubernetes.io/projected/afefcd3a-eafd-4efc-90b9-f6acb16515bc-kube-api-access-vlf7j\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:12.903853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.903843    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:12.903853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.903854    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:12.903853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.903864    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:12.904117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.903873    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afefcd3a-eafd-4efc-90b9-f6acb16515bc-console-oauth-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:12.904117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:12.903880    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afefcd3a-eafd-4efc-90b9-f6acb16515bc-oauth-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:13.570788 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.570755    2575 generic.go:356] "Generic (PLEG): container finished" podID="afefcd3a-eafd-4efc-90b9-f6acb16515bc" containerID="e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326" exitCode=0
Jul 23 15:02:13.571226 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.570802    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4495f488-sl6pd"
Jul 23 15:02:13.571226 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.570812    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4495f488-sl6pd" event={"ID":"afefcd3a-eafd-4efc-90b9-f6acb16515bc","Type":"ContainerDied","Data":"e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326"}
Jul 23 15:02:13.571226 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.570855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4495f488-sl6pd" event={"ID":"afefcd3a-eafd-4efc-90b9-f6acb16515bc","Type":"ContainerDied","Data":"73e2dbc9c4aa75702d1984b0d57384ed12b567ce503b8f40e49d7e0d63fae08f"}
Jul 23 15:02:13.571226 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.570877    2575 scope.go:117] "RemoveContainer" containerID="e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326"
Jul 23 15:02:13.580502 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.580484    2575 scope.go:117] "RemoveContainer" containerID="e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326"
Jul 23 15:02:13.580790 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:02:13.580764    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326\": container with ID starting with e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326 not found: ID does not exist" containerID="e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326"
Jul 23 15:02:13.580868 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.580800    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326"} err="failed to get container status \"e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326\": rpc error: code = NotFound desc = could not find container \"e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326\": container with ID starting with e05f620f683c40cc28c578321e84b2f0aa393ccb4e3b2b0cecc75ea65e62e326 not found: ID does not exist"
Jul 23 15:02:13.593754 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.593729    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4495f488-sl6pd"]
Jul 23 15:02:13.597937 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.597915    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f4495f488-sl6pd"]
Jul 23 15:02:13.865371 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:13.865297    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afefcd3a-eafd-4efc-90b9-f6acb16515bc" path="/var/lib/kubelet/pods/afefcd3a-eafd-4efc-90b9-f6acb16515bc/volumes"
Jul 23 15:02:34.633677 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.633617    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84fc57d588-glbzq" podUID="e5cb0e4e-663b-403b-9772-f6b0562f3585" containerName="console" containerID="cri-o://0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf" gracePeriod=15
Jul 23 15:02:34.883831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.883775    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:02:34.996368 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.996332    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-serving-cert\") pod \"e5cb0e4e-663b-403b-9772-f6b0562f3585\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") "
Jul 23 15:02:34.996368 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.996370    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-service-ca\") pod \"e5cb0e4e-663b-403b-9772-f6b0562f3585\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") "
Jul 23 15:02:34.996605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.996417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-oauth-serving-cert\") pod \"e5cb0e4e-663b-403b-9772-f6b0562f3585\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") "
Jul 23 15:02:34.996605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.996442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nbmg\" (UniqueName: \"kubernetes.io/projected/e5cb0e4e-663b-403b-9772-f6b0562f3585-kube-api-access-9nbmg\") pod \"e5cb0e4e-663b-403b-9772-f6b0562f3585\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") "
Jul 23 15:02:34.996605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.996476    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-config\") pod \"e5cb0e4e-663b-403b-9772-f6b0562f3585\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") "
Jul 23 15:02:34.996605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.996514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-oauth-config\") pod \"e5cb0e4e-663b-403b-9772-f6b0562f3585\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") "
Jul 23 15:02:34.996605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.996553    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-trusted-ca-bundle\") pod \"e5cb0e4e-663b-403b-9772-f6b0562f3585\" (UID: \"e5cb0e4e-663b-403b-9772-f6b0562f3585\") "
Jul 23 15:02:34.997037 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.997004    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e5cb0e4e-663b-403b-9772-f6b0562f3585" (UID: "e5cb0e4e-663b-403b-9772-f6b0562f3585"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:02:34.997037 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.997005    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-service-ca" (OuterVolumeSpecName: "service-ca") pod "e5cb0e4e-663b-403b-9772-f6b0562f3585" (UID: "e5cb0e4e-663b-403b-9772-f6b0562f3585"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:02:34.997037 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.997011    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-config" (OuterVolumeSpecName: "console-config") pod "e5cb0e4e-663b-403b-9772-f6b0562f3585" (UID: "e5cb0e4e-663b-403b-9772-f6b0562f3585"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:02:34.997320 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.997079    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e5cb0e4e-663b-403b-9772-f6b0562f3585" (UID: "e5cb0e4e-663b-403b-9772-f6b0562f3585"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:02:34.998627 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.998597    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e5cb0e4e-663b-403b-9772-f6b0562f3585" (UID: "e5cb0e4e-663b-403b-9772-f6b0562f3585"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:02:34.998733 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.998659    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cb0e4e-663b-403b-9772-f6b0562f3585-kube-api-access-9nbmg" (OuterVolumeSpecName: "kube-api-access-9nbmg") pod "e5cb0e4e-663b-403b-9772-f6b0562f3585" (UID: "e5cb0e4e-663b-403b-9772-f6b0562f3585"). InnerVolumeSpecName "kube-api-access-9nbmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:02:34.998733 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:34.998666    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e5cb0e4e-663b-403b-9772-f6b0562f3585" (UID: "e5cb0e4e-663b-403b-9772-f6b0562f3585"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:02:35.097412 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.097365    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-oauth-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:35.097412 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.097406    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-trusted-ca-bundle\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:35.097412 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.097416    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:35.097412 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.097426    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:35.097412 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.097435    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-oauth-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:35.097720 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.097446    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nbmg\" (UniqueName: \"kubernetes.io/projected/e5cb0e4e-663b-403b-9772-f6b0562f3585-kube-api-access-9nbmg\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:35.097720 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.097455    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5cb0e4e-663b-403b-9772-f6b0562f3585-console-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:02:35.656826 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.656789    2575 generic.go:356] "Generic (PLEG): container finished" podID="e5cb0e4e-663b-403b-9772-f6b0562f3585" containerID="0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf" exitCode=0
Jul 23 15:02:35.656826 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.656828    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fc57d588-glbzq" event={"ID":"e5cb0e4e-663b-403b-9772-f6b0562f3585","Type":"ContainerDied","Data":"0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf"}
Jul 23 15:02:35.657348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.656835    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fc57d588-glbzq"
Jul 23 15:02:35.657348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.656864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fc57d588-glbzq" event={"ID":"e5cb0e4e-663b-403b-9772-f6b0562f3585","Type":"ContainerDied","Data":"7d2669eb214fe4560d3dd76e2471a806c020909166cc9e604e76430081b1dac1"}
Jul 23 15:02:35.657348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.656884    2575 scope.go:117] "RemoveContainer" containerID="0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf"
Jul 23 15:02:35.665919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.665899    2575 scope.go:117] "RemoveContainer" containerID="0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf"
Jul 23 15:02:35.666226 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:02:35.666203    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf\": container with ID starting with 0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf not found: ID does not exist" containerID="0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf"
Jul 23 15:02:35.666287 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.666241    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf"} err="failed to get container status \"0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf\": rpc error: code = NotFound desc = could not find container \"0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf\": container with ID starting with 0ef23c5b4b606ef3118444928e57a1b839c407b86952210341d09942705106cf not found: ID does not exist"
Jul 23 15:02:35.678481 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.678452    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84fc57d588-glbzq"]
Jul 23 15:02:35.681976 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.681952    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84fc57d588-glbzq"]
Jul 23 15:02:35.864567 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:02:35.864532    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5cb0e4e-663b-403b-9772-f6b0562f3585" path="/var/lib/kubelet/pods/e5cb0e4e-663b-403b-9772-f6b0562f3585/volumes"
Jul 23 15:03:12.813442 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:12.813364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:13.597707 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.597671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:13.875479 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.875398    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:03:13.875887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.875671    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="alertmanager" containerID="cri-o://b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03" gracePeriod=120
Jul 23 15:03:13.875887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.875759    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-web" containerID="cri-o://2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b" gracePeriod=120
Jul 23 15:03:13.875887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.875783    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="prom-label-proxy" containerID="cri-o://9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11" gracePeriod=120
Jul 23 15:03:13.875887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.875763    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy" containerID="cri-o://6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435" gracePeriod=120
Jul 23 15:03:13.875887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.875819    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="config-reloader" containerID="cri-o://861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba" gracePeriod=120
Jul 23 15:03:13.876254 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:13.875760    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-metric" containerID="cri-o://e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8" gracePeriod=120
Jul 23 15:03:14.816134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816102    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerID="9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11" exitCode=0
Jul 23 15:03:14.816134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816128    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerID="e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8" exitCode=0
Jul 23 15:03:14.816134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816134    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerID="6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435" exitCode=0
Jul 23 15:03:14.816134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816139    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerID="861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba" exitCode=0
Jul 23 15:03:14.816134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816144    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerID="b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03" exitCode=0
Jul 23 15:03:14.816439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11"}
Jul 23 15:03:14.816439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8"}
Jul 23 15:03:14.816439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435"}
Jul 23 15:03:14.816439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba"}
Jul 23 15:03:14.816439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:14.816325    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03"}
Jul 23 15:03:15.622794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.622769    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.712030 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.711998    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-tls-assets\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712040    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-web\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712068    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-trusted-ca-bundle\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712097    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-web-config\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712129    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-out\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712152    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-main-tls\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712212    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lszb\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-kube-api-access-5lszb\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-main-db\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712284    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712314    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-metrics-client-ca\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712342    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-cluster-tls-config\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712369    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712412    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-volume\") pod \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\" (UID: \"d5c1b3fe-ab19-4728-bbaf-4649d3af551a\") "
Jul 23 15:03:15.712468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712447    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:15.712869 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712615    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:03:15.712869 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712701    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-main-db\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.712869 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712722    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.712869 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.712763    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:15.715216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.715188    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-kube-api-access-5lszb" (OuterVolumeSpecName: "kube-api-access-5lszb") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "kube-api-access-5lszb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:03:15.715356 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.715221    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:15.715356 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.715223    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:03:15.715509 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.715458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:15.715509 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.715477    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-volume" (OuterVolumeSpecName: "config-volume") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:15.715955 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.715929    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:15.716028 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.715952    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:15.716341 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.716320    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-out" (OuterVolumeSpecName: "config-out") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:03:15.719611 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.719593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:15.725424 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.725401    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-web-config" (OuterVolumeSpecName: "web-config") pod "d5c1b3fe-ab19-4728-bbaf-4649d3af551a" (UID: "d5c1b3fe-ab19-4728-bbaf-4649d3af551a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813265    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-tls-assets\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813292    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813302    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-web-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813310    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-out\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813318    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-main-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813326    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lszb\" (UniqueName: \"kubernetes.io/projected/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-kube-api-access-5lszb\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813335    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813346    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-metrics-client-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813687 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813354    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-cluster-tls-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813687 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813363    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.813687 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.813371    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5c1b3fe-ab19-4728-bbaf-4649d3af551a-config-volume\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:15.823049 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.823016    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerID="2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b" exitCode=0
Jul 23 15:03:15.823204 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.823092    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b"}
Jul 23 15:03:15.823204 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.823111    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.823204 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.823180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d5c1b3fe-ab19-4728-bbaf-4649d3af551a","Type":"ContainerDied","Data":"11148b5f78b96377cbbe850986ad1f21f785b64b227ff3a6a338f8ee7fed0791"}
Jul 23 15:03:15.823204 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.823195    2575 scope.go:117] "RemoveContainer" containerID="9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11"
Jul 23 15:03:15.835117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.835094    2575 scope.go:117] "RemoveContainer" containerID="e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8"
Jul 23 15:03:15.842369 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.842344    2575 scope.go:117] "RemoveContainer" containerID="6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435"
Jul 23 15:03:15.849267 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.849249    2575 scope.go:117] "RemoveContainer" containerID="2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b"
Jul 23 15:03:15.854413 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.854388    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:03:15.856577 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.856557    2575 scope.go:117] "RemoveContainer" containerID="861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba"
Jul 23 15:03:15.864860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.864835    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:03:15.865138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.865124    2575 scope.go:117] "RemoveContainer" containerID="b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03"
Jul 23 15:03:15.872199 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.872159    2575 scope.go:117] "RemoveContainer" containerID="5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd"
Jul 23 15:03:15.879735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.879718    2575 scope.go:117] "RemoveContainer" containerID="9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11"
Jul 23 15:03:15.880000 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:15.879977    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11\": container with ID starting with 9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11 not found: ID does not exist" containerID="9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11"
Jul 23 15:03:15.880112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880007    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11"} err="failed to get container status \"9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11\": rpc error: code = NotFound desc = could not find container \"9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11\": container with ID starting with 9c73e3271e5e45e02cb510bcdb85d6f2bc97934c3e12380a7bf62ab490e61f11 not found: ID does not exist"
Jul 23 15:03:15.880112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880031    2575 scope.go:117] "RemoveContainer" containerID="e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8"
Jul 23 15:03:15.880313 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:15.880294    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8\": container with ID starting with e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8 not found: ID does not exist" containerID="e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8"
Jul 23 15:03:15.880403 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880322    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8"} err="failed to get container status \"e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8\": rpc error: code = NotFound desc = could not find container \"e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8\": container with ID starting with e26cb6a03c5a4b27dfb71e0e14c889fd8553a70a4db92dd4ced353c9a9189ab8 not found: ID does not exist"
Jul 23 15:03:15.880403 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880340    2575 scope.go:117] "RemoveContainer" containerID="6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435"
Jul 23 15:03:15.880580 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:15.880558    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435\": container with ID starting with 6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435 not found: ID does not exist" containerID="6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435"
Jul 23 15:03:15.880665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880589    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435"} err="failed to get container status \"6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435\": rpc error: code = NotFound desc = could not find container \"6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435\": container with ID starting with 6fb100ea28751ef0ae37cba797b6fba1b0c17d83c8acf58d7ca2d9abe8881435 not found: ID does not exist"
Jul 23 15:03:15.880665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880610    2575 scope.go:117] "RemoveContainer" containerID="2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b"
Jul 23 15:03:15.880821 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:15.880804    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b\": container with ID starting with 2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b not found: ID does not exist" containerID="2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b"
Jul 23 15:03:15.880876 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880826    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b"} err="failed to get container status \"2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b\": rpc error: code = NotFound desc = could not find container \"2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b\": container with ID starting with 2f0c2e366c2889958e5a1df76283229fb5a028a1819edba20a095c14c3bdc18b not found: ID does not exist"
Jul 23 15:03:15.880876 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.880847    2575 scope.go:117] "RemoveContainer" containerID="861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba"
Jul 23 15:03:15.881073 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:15.881057    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba\": container with ID starting with 861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba not found: ID does not exist" containerID="861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba"
Jul 23 15:03:15.881110 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.881079    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba"} err="failed to get container status \"861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba\": rpc error: code = NotFound desc = could not find container \"861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba\": container with ID starting with 861873a772d1fc1d3e02dc2bce64c600510912e0e773f37529ea7b9b23560eba not found: ID does not exist"
Jul 23 15:03:15.881110 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.881098    2575 scope.go:117] "RemoveContainer" containerID="b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03"
Jul 23 15:03:15.881329 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:15.881306    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03\": container with ID starting with b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03 not found: ID does not exist" containerID="b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03"
Jul 23 15:03:15.881425 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.881331    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03"} err="failed to get container status \"b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03\": rpc error: code = NotFound desc = could not find container \"b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03\": container with ID starting with b628031886b473135e02675c4c8fb27142e7644fa088e3da100cc0049c9adc03 not found: ID does not exist"
Jul 23 15:03:15.881425 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.881348    2575 scope.go:117] "RemoveContainer" containerID="5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd"
Jul 23 15:03:15.881561 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:15.881541    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd\": container with ID starting with 5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd not found: ID does not exist" containerID="5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd"
Jul 23 15:03:15.881618 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.881565    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd"} err="failed to get container status \"5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd\": rpc error: code = NotFound desc = could not find container \"5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd\": container with ID starting with 5b14cbc312c3d0534cc878672d6a10263d904255678dec76274dac1108df36fd not found: ID does not exist"
Jul 23 15:03:15.889321 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889302    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:03:15.889557 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889546    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="alertmanager"
Jul 23 15:03:15.889601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889558    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="alertmanager"
Jul 23 15:03:15.889601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889568    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afefcd3a-eafd-4efc-90b9-f6acb16515bc" containerName="console"
Jul 23 15:03:15.889601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889574    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="afefcd3a-eafd-4efc-90b9-f6acb16515bc" containerName="console"
Jul 23 15:03:15.889601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889582    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="init-config-reloader"
Jul 23 15:03:15.889601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889588    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="init-config-reloader"
Jul 23 15:03:15.889601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889597    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-metric"
Jul 23 15:03:15.889601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889602    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-metric"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889609    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="config-reloader"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889615    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="config-reloader"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889622    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="prom-label-proxy"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889628    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="prom-label-proxy"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889634    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-web"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889639    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-web"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889645    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889650    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889662    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cb0e4e-663b-403b-9772-f6b0562f3585" containerName="console"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889667    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cb0e4e-663b-403b-9772-f6b0562f3585" containerName="console"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889711    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889720    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="config-reloader"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889726    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-metric"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889732    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="kube-rbac-proxy-web"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889737    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="prom-label-proxy"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889742    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" containerName="alertmanager"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889747    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="afefcd3a-eafd-4efc-90b9-f6acb16515bc" containerName="console"
Jul 23 15:03:15.889794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.889752    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cb0e4e-663b-403b-9772-f6b0562f3585" containerName="console"
Jul 23 15:03:15.894847 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.894831    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.897650 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.897612    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 15:03:15.897650 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.897627    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wr8dx\""
Jul 23 15:03:15.897650 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.897619    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 15:03:15.897853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.897657    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 15:03:15.897853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.897634    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 15:03:15.897853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.897790    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 15:03:15.897978 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.897875    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 15:03:15.898030 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.898004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 15:03:15.898070 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.898043    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 15:03:15.903894 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.903876    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 15:03:15.911636 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.911615    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:03:15.914369 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914462 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbhd\" (UniqueName: \"kubernetes.io/projected/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-kube-api-access-lfbhd\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914462 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-config-volume\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914549 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914655 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914716 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914716 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914795 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914874 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-config-out\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914922 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.914922 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.915025 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:15.915025 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:15.914961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-web-config\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016213 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016213 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-config-out\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-web-config\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbhd\" (UniqueName: \"kubernetes.io/projected/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-kube-api-access-lfbhd\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.016725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-config-volume\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.017003 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.017003 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.016891    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.017557 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.017526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.019156 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.018902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.019370 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.019283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.019827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.019675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.019827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.019801    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.019827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.019798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.020048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.019936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-config-out\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.020215 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.020195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.020302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.020255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.020302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.020274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-config-volume\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.021373 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.021354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-web-config\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.029628 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.029605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbhd\" (UniqueName: \"kubernetes.io/projected/37dd464b-79ed-43e4-8e6e-2d25ee81e92e-kube-api-access-lfbhd\") pod \"alertmanager-main-0\" (UID: \"37dd464b-79ed-43e4-8e6e-2d25ee81e92e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.204683 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.204651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:03:16.350923 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.350888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:03:16.355198 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:03:16.355156    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37dd464b_79ed_43e4_8e6e_2d25ee81e92e.slice/crio-5499393fc7c23462832f0dc83d1e903a261ee5866d536670f25f2ae3a15d204f WatchSource:0}: Error finding container 5499393fc7c23462832f0dc83d1e903a261ee5866d536670f25f2ae3a15d204f: Status 404 returned error can't find the container with id 5499393fc7c23462832f0dc83d1e903a261ee5866d536670f25f2ae3a15d204f
Jul 23 15:03:16.399516 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:03:16.399480    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37dd464b_79ed_43e4_8e6e_2d25ee81e92e.slice/crio-21ae684e0a8b8d307732c86da6a2a95016e8575417f52dabe89cf923734cec87.scope\": RecentStats: unable to find data in memory cache]"
Jul 23 15:03:16.828518 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.828479    2575 generic.go:356] "Generic (PLEG): container finished" podID="37dd464b-79ed-43e4-8e6e-2d25ee81e92e" containerID="21ae684e0a8b8d307732c86da6a2a95016e8575417f52dabe89cf923734cec87" exitCode=0
Jul 23 15:03:16.828936 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.828558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerDied","Data":"21ae684e0a8b8d307732c86da6a2a95016e8575417f52dabe89cf923734cec87"}
Jul 23 15:03:16.828936 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:16.828631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerStarted","Data":"5499393fc7c23462832f0dc83d1e903a261ee5866d536670f25f2ae3a15d204f"}
Jul 23 15:03:17.838499 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.838458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerStarted","Data":"9254daa0006aa56651fed914b69aecf18650c1a5d559f4e6763bb5fe8261aaa7"}
Jul 23 15:03:17.838926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.838583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerStarted","Data":"ac6084bdeee6425b5cc4dff71c53a145be88304edfed2afb5dd3d41cb3c7ed24"}
Jul 23 15:03:17.838926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.838626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerStarted","Data":"12ff2a941fec5068627360e8109f6327b1e56b357e9d63531eaa16332256847d"}
Jul 23 15:03:17.838926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.838666    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerStarted","Data":"45094ec0711cd74044f751907d4521932b4bbce840e06bbfca7f96d4b921021a"}
Jul 23 15:03:17.838926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.838708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerStarted","Data":"9e6985dda754d5a3634c7e60b9ddc55376dec2c808b6cea114b1d4efca7686ec"}
Jul 23 15:03:17.838926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.838746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37dd464b-79ed-43e4-8e6e-2d25ee81e92e","Type":"ContainerStarted","Data":"f256253e72b95a16db523267c688bb7ceed02ca42543620efc9ab03eb1a8036e"}
Jul 23 15:03:17.867368 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.867326    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5c1b3fe-ab19-4728-bbaf-4649d3af551a" path="/var/lib/kubelet/pods/d5c1b3fe-ab19-4728-bbaf-4649d3af551a/volumes"
Jul 23 15:03:17.879003 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:17.878948    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.862506724 podStartE2EDuration="2.878931s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.424276ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:03:17.876003293 +0000 UTC m=+182.589935231" watchObservedRunningTime="2026-07-23 15:03:17.878931 +0000 UTC m=+182.592862937"
Jul 23 15:03:18.036080 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.036038    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74696b984b-rb7tp"]
Jul 23 15:03:18.040536 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.040519    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.056714 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.056687    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 15:03:18.056835 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.056735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 15:03:18.056958 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.056944    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 15:03:18.057158 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.057144    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8x6kf\""
Jul 23 15:03:18.057158 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.057151    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 15:03:18.062283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.062263    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 15:03:18.066345 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.066328    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 15:03:18.078277 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.078252    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74696b984b-rb7tp"]
Jul 23 15:03:18.137509 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-serving-certs-ca-bundle\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.137685 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-metrics-client-ca\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.137685 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.137685 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-secret-telemeter-client\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.137685 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-telemeter-client-tls\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.137685 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.137685 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-federate-client-tls\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.137987 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.137770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqblq\" (UniqueName: \"kubernetes.io/projected/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-kube-api-access-mqblq\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqblq\" (UniqueName: \"kubernetes.io/projected/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-kube-api-access-mqblq\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-serving-certs-ca-bundle\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-metrics-client-ca\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-secret-telemeter-client\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-telemeter-client-tls\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.238744 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.238483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-federate-client-tls\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.239089 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.239057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-metrics-client-ca\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.239210 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.239090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-serving-certs-ca-bundle\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.239420 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.239396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.240900 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.240878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.241104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.241081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-secret-telemeter-client\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.241251 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.241231    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-telemeter-client-tls\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.241355 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.241336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-federate-client-tls\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.247431 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.247411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqblq\" (UniqueName: \"kubernetes.io/projected/0bfc7f61-7ec5-459c-8c31-86cfcca7102a-kube-api-access-mqblq\") pod \"telemeter-client-74696b984b-rb7tp\" (UID: \"0bfc7f61-7ec5-459c-8c31-86cfcca7102a\") " pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.349734 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.349691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp"
Jul 23 15:03:18.502018 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.501983    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74696b984b-rb7tp"]
Jul 23 15:03:18.509425 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:03:18.509379    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bfc7f61_7ec5_459c_8c31_86cfcca7102a.slice/crio-824729256c21b0644ec5476122da994549f87a471e89ac8025c9c4311f3b0aa9 WatchSource:0}: Error finding container 824729256c21b0644ec5476122da994549f87a471e89ac8025c9c4311f3b0aa9: Status 404 returned error can't find the container with id 824729256c21b0644ec5476122da994549f87a471e89ac8025c9c4311f3b0aa9
Jul 23 15:03:18.844274 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:18.844237    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp" event={"ID":"0bfc7f61-7ec5-459c-8c31-86cfcca7102a","Type":"ContainerStarted","Data":"824729256c21b0644ec5476122da994549f87a471e89ac8025c9c4311f3b0aa9"}
Jul 23 15:03:21.859056 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:21.859015    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp" event={"ID":"0bfc7f61-7ec5-459c-8c31-86cfcca7102a","Type":"ContainerStarted","Data":"55c6415b027c8520a7238c09b8adf627ac35a62f6c2dd1ae2438257f8050c4fb"}
Jul 23 15:03:21.859447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:21.859083    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp" event={"ID":"0bfc7f61-7ec5-459c-8c31-86cfcca7102a","Type":"ContainerStarted","Data":"761662157bb4e5150e85325c999c84d4f0cf02e05ee7649e44ac0b0b061b0626"}
Jul 23 15:03:21.859447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:21.859111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp" event={"ID":"0bfc7f61-7ec5-459c-8c31-86cfcca7102a","Type":"ContainerStarted","Data":"22515ee201f10db86b1460a7c3d6e57a694743e9545adb89962ab64aa0384e64"}
Jul 23 15:03:21.885010 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:21.884957    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74696b984b-rb7tp" podStartSLOduration=2.561687532 podStartE2EDuration="4.884942477s" totalImagesPullingTime="2.323254945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:03:21.883100585 +0000 UTC m=+186.597032522" watchObservedRunningTime="2026-07-23 15:03:21.884942477 +0000 UTC m=+186.598874416"
Jul 23 15:03:22.804326 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.804293    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f59d4674-46qsl"]
Jul 23 15:03:22.807643 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.807624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.822036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.822008    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f59d4674-46qsl"]
Jul 23 15:03:22.859555 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.859523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:22.877387 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.877361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-oauth-config\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.877588 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.877392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-serving-cert\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.877588 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.877417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-service-ca\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.877588 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.877502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gq98\" (UniqueName: \"kubernetes.io/projected/92976dd0-cf7d-45d6-8602-fa4c5666b75a-kube-api-access-5gq98\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.877741 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.877596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-config\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.877741 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.877645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-trusted-ca-bundle\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.877741 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.877676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-oauth-serving-cert\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.931797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.931763    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:22.979140 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.979105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gq98\" (UniqueName: \"kubernetes.io/projected/92976dd0-cf7d-45d6-8602-fa4c5666b75a-kube-api-access-5gq98\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.979297 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.979206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-config\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.979297 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.979249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-trusted-ca-bundle\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.979392 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.979301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-oauth-serving-cert\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.979464 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.979447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-oauth-config\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.979510 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.979484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-serving-cert\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.979585 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.979551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-service-ca\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.980242 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.980210    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-oauth-serving-cert\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.980388 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.980257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-config\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.980388 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.980337    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-service-ca\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.980388 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.980336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-trusted-ca-bundle\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.982140 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.982121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-oauth-config\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.982453 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.982434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-serving-cert\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:22.992331 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:22.992312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gq98\" (UniqueName: \"kubernetes.io/projected/92976dd0-cf7d-45d6-8602-fa4c5666b75a-kube-api-access-5gq98\") pod \"console-57f59d4674-46qsl\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") " pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:23.007878 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.007819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:23.074391 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.074310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:23.118269 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.118232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:23.251645 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.251621    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f59d4674-46qsl"]
Jul 23 15:03:23.254107 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:03:23.254084    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92976dd0_cf7d_45d6_8602_fa4c5666b75a.slice/crio-355d0cf0ef3b9e276139406c07d35bd7e53ec28552714f32fdb242367b5e1670 WatchSource:0}: Error finding container 355d0cf0ef3b9e276139406c07d35bd7e53ec28552714f32fdb242367b5e1670: Status 404 returned error can't find the container with id 355d0cf0ef3b9e276139406c07d35bd7e53ec28552714f32fdb242367b5e1670
Jul 23 15:03:23.634077 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.634046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:23.791975 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.791942    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:23.867212 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.867156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f59d4674-46qsl" event={"ID":"92976dd0-cf7d-45d6-8602-fa4c5666b75a","Type":"ContainerStarted","Data":"7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8"}
Jul 23 15:03:23.867595 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.867235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f59d4674-46qsl" event={"ID":"92976dd0-cf7d-45d6-8602-fa4c5666b75a","Type":"ContainerStarted","Data":"355d0cf0ef3b9e276139406c07d35bd7e53ec28552714f32fdb242367b5e1670"}
Jul 23 15:03:23.889092 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:23.888993    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57f59d4674-46qsl" podStartSLOduration=1.8889763880000001 podStartE2EDuration="1.888976388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:03:23.887510322 +0000 UTC m=+188.601442263" watchObservedRunningTime="2026-07-23 15:03:23.888976388 +0000 UTC m=+188.602908324"
Jul 23 15:03:33.119343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:33.119279    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:33.119851 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:33.119366    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:33.124106 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:33.124089    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:33.909384 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:33.909357    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:03:33.964930 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:33.964887    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78798c8c7-gvhp5"]
Jul 23 15:03:34.091919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:34.091887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:34.193431 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:34.193391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:34.259531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:34.259496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:38.144813 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:38.144771    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:03:58.986217 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:58.986148    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78798c8c7-gvhp5" podUID="6d79b1db-15cd-477b-9a34-794898d6e688" containerName="console" containerID="cri-o://7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91" gracePeriod=15
Jul 23 15:03:59.230523 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.230497    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:03:59.399663 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.399551    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-console-config\") pod \"6d79b1db-15cd-477b-9a34-794898d6e688\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") "
Jul 23 15:03:59.399663 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.399633    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-oauth-config\") pod \"6d79b1db-15cd-477b-9a34-794898d6e688\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") "
Jul 23 15:03:59.399855 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.399696    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-serving-cert\") pod \"6d79b1db-15cd-477b-9a34-794898d6e688\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") "
Jul 23 15:03:59.399855 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.399725    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-trusted-ca-bundle\") pod \"6d79b1db-15cd-477b-9a34-794898d6e688\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") "
Jul 23 15:03:59.399855 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.399775    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrzx5\" (UniqueName: \"kubernetes.io/projected/6d79b1db-15cd-477b-9a34-794898d6e688-kube-api-access-mrzx5\") pod \"6d79b1db-15cd-477b-9a34-794898d6e688\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") "
Jul 23 15:03:59.399855 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.399816    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-service-ca\") pod \"6d79b1db-15cd-477b-9a34-794898d6e688\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") "
Jul 23 15:03:59.400054 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.399868    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-oauth-serving-cert\") pod \"6d79b1db-15cd-477b-9a34-794898d6e688\" (UID: \"6d79b1db-15cd-477b-9a34-794898d6e688\") "
Jul 23 15:03:59.400194 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.400135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-console-config" (OuterVolumeSpecName: "console-config") pod "6d79b1db-15cd-477b-9a34-794898d6e688" (UID: "6d79b1db-15cd-477b-9a34-794898d6e688"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:59.400347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.400303    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d79b1db-15cd-477b-9a34-794898d6e688" (UID: "6d79b1db-15cd-477b-9a34-794898d6e688"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:59.400347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.400314    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6d79b1db-15cd-477b-9a34-794898d6e688" (UID: "6d79b1db-15cd-477b-9a34-794898d6e688"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:59.400347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.400331    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d79b1db-15cd-477b-9a34-794898d6e688" (UID: "6d79b1db-15cd-477b-9a34-794898d6e688"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:59.401974 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.401950    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d79b1db-15cd-477b-9a34-794898d6e688" (UID: "6d79b1db-15cd-477b-9a34-794898d6e688"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:59.402075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.401971    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d79b1db-15cd-477b-9a34-794898d6e688" (UID: "6d79b1db-15cd-477b-9a34-794898d6e688"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:59.402075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.402020    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d79b1db-15cd-477b-9a34-794898d6e688-kube-api-access-mrzx5" (OuterVolumeSpecName: "kube-api-access-mrzx5") pod "6d79b1db-15cd-477b-9a34-794898d6e688" (UID: "6d79b1db-15cd-477b-9a34-794898d6e688"). InnerVolumeSpecName "kube-api-access-mrzx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:03:59.501259 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.501222    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:59.501259 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.501253    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-trusted-ca-bundle\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:59.501259 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.501263    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrzx5\" (UniqueName: \"kubernetes.io/projected/6d79b1db-15cd-477b-9a34-794898d6e688-kube-api-access-mrzx5\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:59.501490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.501272    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:59.501490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.501282    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-oauth-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:59.501490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.501290    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d79b1db-15cd-477b-9a34-794898d6e688-console-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:03:59.501490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:03:59.501298    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d79b1db-15cd-477b-9a34-794898d6e688-console-oauth-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:04:00.010549 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.010511    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d79b1db-15cd-477b-9a34-794898d6e688" containerID="7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91" exitCode=0
Jul 23 15:04:00.010955 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.010574    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78798c8c7-gvhp5"
Jul 23 15:04:00.010955 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.010598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78798c8c7-gvhp5" event={"ID":"6d79b1db-15cd-477b-9a34-794898d6e688","Type":"ContainerDied","Data":"7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91"}
Jul 23 15:04:00.010955 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.010670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78798c8c7-gvhp5" event={"ID":"6d79b1db-15cd-477b-9a34-794898d6e688","Type":"ContainerDied","Data":"eab1d787d7a554042f7cec9462bf71f91d4de5e85b253bd3e40edf79382b6fea"}
Jul 23 15:04:00.010955 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.010691    2575 scope.go:117] "RemoveContainer" containerID="7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91"
Jul 23 15:04:00.018649 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.018631    2575 scope.go:117] "RemoveContainer" containerID="7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91"
Jul 23 15:04:00.018908 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:04:00.018880    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91\": container with ID starting with 7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91 not found: ID does not exist" containerID="7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91"
Jul 23 15:04:00.018953 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.018916    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91"} err="failed to get container status \"7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91\": rpc error: code = NotFound desc = could not find container \"7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91\": container with ID starting with 7b9fd27ca24336d0fed135f597b93e2bd4bde302cdcaedef463b4d264c92de91 not found: ID does not exist"
Jul 23 15:04:00.029389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.029368    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78798c8c7-gvhp5"]
Jul 23 15:04:00.033444 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.033425    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78798c8c7-gvhp5"]
Jul 23 15:04:00.284101 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.284066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:00.351899 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:00.351864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:01.864805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:01.864771    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d79b1db-15cd-477b-9a34-794898d6e688" path="/var/lib/kubelet/pods/6d79b1db-15cd-477b-9a34-794898d6e688/volumes"
Jul 23 15:04:28.213940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.213906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:28.313644 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.313612    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:28.408305 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.408268    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6947c47dd6-g9gmx"]
Jul 23 15:04:28.408627 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.408608    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d79b1db-15cd-477b-9a34-794898d6e688" containerName="console"
Jul 23 15:04:28.408627 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.408624    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d79b1db-15cd-477b-9a34-794898d6e688" containerName="console"
Jul 23 15:04:28.408782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.408680    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d79b1db-15cd-477b-9a34-794898d6e688" containerName="console"
Jul 23 15:04:28.411621 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.411596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.426360 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.426337    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6947c47dd6-g9gmx"]
Jul 23 15:04:28.467297 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.467192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:28.541586 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.541552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:28.554548 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.554521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-service-ca\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.554688 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.554564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-oauth-serving-cert\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.554688 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.554591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-config\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.554688 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.554676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhctb\" (UniqueName: \"kubernetes.io/projected/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-kube-api-access-xhctb\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.554809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.554705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-oauth-config\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.554809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.554726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-serving-cert\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.554809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.554763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-trusted-ca-bundle\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.616136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.616095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:28.655497 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.655462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-serving-cert\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.655677 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.655514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-trusted-ca-bundle\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.655677 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.655567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-service-ca\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.655677 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.655620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-oauth-serving-cert\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.655677 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.655658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-config\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.655868 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.655695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhctb\" (UniqueName: \"kubernetes.io/projected/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-kube-api-access-xhctb\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.655868 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.655728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-oauth-config\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.656738 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.656712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-oauth-serving-cert\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.656836 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.656779    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-service-ca\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.656836 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.656820    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-trusted-ca-bundle\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.656905 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.656866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-config\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.658272 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.658242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-serving-cert\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.658272 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.658262    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-oauth-config\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.666418 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.666393    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhctb\" (UniqueName: \"kubernetes.io/projected/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-kube-api-access-xhctb\") pod \"console-6947c47dd6-g9gmx\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") " pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.721658 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.721550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:28.852467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:28.852436    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6947c47dd6-g9gmx"]
Jul 23 15:04:28.855464 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:04:28.855438    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ae5a5b_a1b1_4be6_a8d9_4392d6ab626c.slice/crio-4d35697692899e710e9f0db7d439809a9586781a50394451f871e1a5ea0c9e2f WatchSource:0}: Error finding container 4d35697692899e710e9f0db7d439809a9586781a50394451f871e1a5ea0c9e2f: Status 404 returned error can't find the container with id 4d35697692899e710e9f0db7d439809a9586781a50394451f871e1a5ea0c9e2f
Jul 23 15:04:29.119737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:29.119644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6947c47dd6-g9gmx" event={"ID":"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c","Type":"ContainerStarted","Data":"447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762"}
Jul 23 15:04:29.119737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:29.119695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6947c47dd6-g9gmx" event={"ID":"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c","Type":"ContainerStarted","Data":"4d35697692899e710e9f0db7d439809a9586781a50394451f871e1a5ea0c9e2f"}
Jul 23 15:04:29.140287 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:29.140235    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6947c47dd6-g9gmx" podStartSLOduration=1.140217879 podStartE2EDuration="1.140217879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:04:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:04:29.138578473 +0000 UTC m=+253.852510411" watchObservedRunningTime="2026-07-23 15:04:29.140217879 +0000 UTC m=+253.854149817"
Jul 23 15:04:29.293550 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:29.293512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:29.368821 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:29.368791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:38.722036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:38.721941    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:38.722036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:38.722020    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:38.726833 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:38.726807    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:39.160708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:39.160628    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:04:39.217112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:39.217075    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f59d4674-46qsl"]
Jul 23 15:04:39.342411 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:39.342374    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:39.466460 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:39.466429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:39.530316 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:39.530283    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:40.780298 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:40.780266    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:40.880578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:40.880548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:56.766015 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:56.765980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:56.860996 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:56.860957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:04:56.951152 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:04:56.951116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:05:04.238996 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.238928    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57f59d4674-46qsl" podUID="92976dd0-cf7d-45d6-8602-fa4c5666b75a" containerName="console" containerID="cri-o://7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8" gracePeriod=15
Jul 23 15:05:04.485356 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.485330    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:05:04.575010 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.574917    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gq98\" (UniqueName: \"kubernetes.io/projected/92976dd0-cf7d-45d6-8602-fa4c5666b75a-kube-api-access-5gq98\") pod \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") "
Jul 23 15:05:04.575010 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.574957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-trusted-ca-bundle\") pod \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") "
Jul 23 15:05:04.575010 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.574996    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-serving-cert\") pod \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") "
Jul 23 15:05:04.575317 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575043    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-service-ca\") pod \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") "
Jul 23 15:05:04.575317 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575221    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-config\") pod \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") "
Jul 23 15:05:04.575317 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575292    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-oauth-serving-cert\") pod \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") "
Jul 23 15:05:04.575463 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575368    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-oauth-config\") pod \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\" (UID: \"92976dd0-cf7d-45d6-8602-fa4c5666b75a\") "
Jul 23 15:05:04.575603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575572    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-service-ca" (OuterVolumeSpecName: "service-ca") pod "92976dd0-cf7d-45d6-8602-fa4c5666b75a" (UID: "92976dd0-cf7d-45d6-8602-fa4c5666b75a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:05:04.575743 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575672    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:05:04.575743 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575707    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92976dd0-cf7d-45d6-8602-fa4c5666b75a" (UID: "92976dd0-cf7d-45d6-8602-fa4c5666b75a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:05:04.575879 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575857    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92976dd0-cf7d-45d6-8602-fa4c5666b75a" (UID: "92976dd0-cf7d-45d6-8602-fa4c5666b75a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:05:04.575988 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.575964    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-config" (OuterVolumeSpecName: "console-config") pod "92976dd0-cf7d-45d6-8602-fa4c5666b75a" (UID: "92976dd0-cf7d-45d6-8602-fa4c5666b75a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:05:04.577274 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.577244    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92976dd0-cf7d-45d6-8602-fa4c5666b75a" (UID: "92976dd0-cf7d-45d6-8602-fa4c5666b75a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:05:04.577370 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.577299    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92976dd0-cf7d-45d6-8602-fa4c5666b75a-kube-api-access-5gq98" (OuterVolumeSpecName: "kube-api-access-5gq98") pod "92976dd0-cf7d-45d6-8602-fa4c5666b75a" (UID: "92976dd0-cf7d-45d6-8602-fa4c5666b75a"). InnerVolumeSpecName "kube-api-access-5gq98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:05:04.577431 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.577408    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92976dd0-cf7d-45d6-8602-fa4c5666b75a" (UID: "92976dd0-cf7d-45d6-8602-fa4c5666b75a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:05:04.676504 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.676465    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-oauth-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:05:04.676504 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.676500    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-oauth-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:05:04.676504 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.676511    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gq98\" (UniqueName: \"kubernetes.io/projected/92976dd0-cf7d-45d6-8602-fa4c5666b75a-kube-api-access-5gq98\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:05:04.676745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.676520    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-trusted-ca-bundle\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:05:04.676745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.676531    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:05:04.676745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:04.676548    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92976dd0-cf7d-45d6-8602-fa4c5666b75a-console-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:05:05.257237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.257202    2575 generic.go:356] "Generic (PLEG): container finished" podID="92976dd0-cf7d-45d6-8602-fa4c5666b75a" containerID="7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8" exitCode=0
Jul 23 15:05:05.257609 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.257252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f59d4674-46qsl" event={"ID":"92976dd0-cf7d-45d6-8602-fa4c5666b75a","Type":"ContainerDied","Data":"7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8"}
Jul 23 15:05:05.257609 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.257296    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f59d4674-46qsl"
Jul 23 15:05:05.257609 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.257303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f59d4674-46qsl" event={"ID":"92976dd0-cf7d-45d6-8602-fa4c5666b75a","Type":"ContainerDied","Data":"355d0cf0ef3b9e276139406c07d35bd7e53ec28552714f32fdb242367b5e1670"}
Jul 23 15:05:05.257609 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.257325    2575 scope.go:117] "RemoveContainer" containerID="7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8"
Jul 23 15:05:05.265817 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.265801    2575 scope.go:117] "RemoveContainer" containerID="7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8"
Jul 23 15:05:05.266081 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:05:05.266063    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8\": container with ID starting with 7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8 not found: ID does not exist" containerID="7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8"
Jul 23 15:05:05.266134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.266091    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8"} err="failed to get container status \"7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8\": rpc error: code = NotFound desc = could not find container \"7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8\": container with ID starting with 7e0bb112d8957a20e3c5b8bdc9707ea99cc36cb5a1c3036bfb63a1f578a3bbd8 not found: ID does not exist"
Jul 23 15:05:05.279207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.279165    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f59d4674-46qsl"]
Jul 23 15:05:05.283894 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.283869    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57f59d4674-46qsl"]
Jul 23 15:05:05.864950 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:05.864908    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92976dd0-cf7d-45d6-8602-fa4c5666b75a" path="/var/lib/kubelet/pods/92976dd0-cf7d-45d6-8602-fa4c5666b75a/volumes"
Jul 23 15:05:15.734272 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:15.734235    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 15:05:42.247508 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:42.247474    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:05:44.832696 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:05:44.832661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:04.292434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:04.292401    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:05.188506 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:05.188474    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:08.284675 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:08.284601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:08.383023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:08.382954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:10.024367 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:10.024325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:10.141710 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:10.141684    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:10.389512 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:10.389415    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:10.611621 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:10.611591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:12.808367 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:12.808335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:13.365768 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:13.365731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:15.081577 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:15.081549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:15.601915 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:15.601881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:20.389063 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:20.389030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:22.404671 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.404612    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:22.500789 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.500759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:22.868009 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.867971    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tqhcj"]
Jul 23 15:06:22.868364 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.868348    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92976dd0-cf7d-45d6-8602-fa4c5666b75a" containerName="console"
Jul 23 15:06:22.868468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.868367    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="92976dd0-cf7d-45d6-8602-fa4c5666b75a" containerName="console"
Jul 23 15:06:22.868468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.868462    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="92976dd0-cf7d-45d6-8602-fa4c5666b75a" containerName="console"
Jul 23 15:06:22.871316 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.871295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:22.874180 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.874146    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 15:06:22.874271 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.874254    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dzqhw\""
Jul 23 15:06:22.875246 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.875232    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 15:06:22.881199 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.881159    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tqhcj"]
Jul 23 15:06:22.930001 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.929968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4d49938-0fce-4525-9b32-d938d9c812d4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tqhcj\" (UID: \"e4d49938-0fce-4525-9b32-d938d9c812d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:22.930216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:22.930010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk8ds\" (UniqueName: \"kubernetes.io/projected/e4d49938-0fce-4525-9b32-d938d9c812d4-kube-api-access-gk8ds\") pod \"cert-manager-webhook-6486ffd997-tqhcj\" (UID: \"e4d49938-0fce-4525-9b32-d938d9c812d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:23.031187 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.031140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4d49938-0fce-4525-9b32-d938d9c812d4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tqhcj\" (UID: \"e4d49938-0fce-4525-9b32-d938d9c812d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:23.031365 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.031207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk8ds\" (UniqueName: \"kubernetes.io/projected/e4d49938-0fce-4525-9b32-d938d9c812d4-kube-api-access-gk8ds\") pod \"cert-manager-webhook-6486ffd997-tqhcj\" (UID: \"e4d49938-0fce-4525-9b32-d938d9c812d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:23.040731 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.040698    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4d49938-0fce-4525-9b32-d938d9c812d4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tqhcj\" (UID: \"e4d49938-0fce-4525-9b32-d938d9c812d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:23.040922 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.040903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk8ds\" (UniqueName: \"kubernetes.io/projected/e4d49938-0fce-4525-9b32-d938d9c812d4-kube-api-access-gk8ds\") pod \"cert-manager-webhook-6486ffd997-tqhcj\" (UID: \"e4d49938-0fce-4525-9b32-d938d9c812d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:23.189776 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.189741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:23.319927 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.319901    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tqhcj"]
Jul 23 15:06:23.322456 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:06:23.322419    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4d49938_0fce_4525_9b32_d938d9c812d4.slice/crio-711d1309867187d781f07975dc03ae7d62aa7a88a8007cf6c0526ffbe6e3b7b7 WatchSource:0}: Error finding container 711d1309867187d781f07975dc03ae7d62aa7a88a8007cf6c0526ffbe6e3b7b7: Status 404 returned error can't find the container with id 711d1309867187d781f07975dc03ae7d62aa7a88a8007cf6c0526ffbe6e3b7b7
Jul 23 15:06:23.324475 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.324460    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:06:23.561758 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.561673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj" event={"ID":"e4d49938-0fce-4525-9b32-d938d9c812d4","Type":"ContainerStarted","Data":"711d1309867187d781f07975dc03ae7d62aa7a88a8007cf6c0526ffbe6e3b7b7"}
Jul 23 15:06:23.735466 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.735431    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"]
Jul 23 15:06:23.739623 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.739604    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:23.748110 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.743042    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 15:06:23.748110 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.743454    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vsthh\""
Jul 23 15:06:23.748110 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.743729    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:06:23.750064 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.750040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"]
Jul 23 15:06:23.837668 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.837574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f83c07-b383-4d6b-87ec-8343ac14a6a3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2shsv\" (UID: \"d2f83c07-b383-4d6b-87ec-8343ac14a6a3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:23.837668 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.837629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp85b\" (UniqueName: \"kubernetes.io/projected/d2f83c07-b383-4d6b-87ec-8343ac14a6a3-kube-api-access-tp85b\") pod \"openshift-lws-operator-fd8ccff4c-2shsv\" (UID: \"d2f83c07-b383-4d6b-87ec-8343ac14a6a3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:23.938538 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.938503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f83c07-b383-4d6b-87ec-8343ac14a6a3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2shsv\" (UID: \"d2f83c07-b383-4d6b-87ec-8343ac14a6a3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:23.938538 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.938543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp85b\" (UniqueName: \"kubernetes.io/projected/d2f83c07-b383-4d6b-87ec-8343ac14a6a3-kube-api-access-tp85b\") pod \"openshift-lws-operator-fd8ccff4c-2shsv\" (UID: \"d2f83c07-b383-4d6b-87ec-8343ac14a6a3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:23.939036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.939010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f83c07-b383-4d6b-87ec-8343ac14a6a3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2shsv\" (UID: \"d2f83c07-b383-4d6b-87ec-8343ac14a6a3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:23.948775 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:23.948748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp85b\" (UniqueName: \"kubernetes.io/projected/d2f83c07-b383-4d6b-87ec-8343ac14a6a3-kube-api-access-tp85b\") pod \"openshift-lws-operator-fd8ccff4c-2shsv\" (UID: \"d2f83c07-b383-4d6b-87ec-8343ac14a6a3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:24.054865 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:24.054829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"
Jul 23 15:06:24.238859 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:24.238773    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv"]
Jul 23 15:06:24.241682 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:06:24.241642    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2f83c07_b383_4d6b_87ec_8343ac14a6a3.slice/crio-b21ef8e4349ea7cd16d191f40e79cd2867c7be3a001e15354c27446de1e56645 WatchSource:0}: Error finding container b21ef8e4349ea7cd16d191f40e79cd2867c7be3a001e15354c27446de1e56645: Status 404 returned error can't find the container with id b21ef8e4349ea7cd16d191f40e79cd2867c7be3a001e15354c27446de1e56645
Jul 23 15:06:24.568996 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:24.568949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv" event={"ID":"d2f83c07-b383-4d6b-87ec-8343ac14a6a3","Type":"ContainerStarted","Data":"b21ef8e4349ea7cd16d191f40e79cd2867c7be3a001e15354c27446de1e56645"}
Jul 23 15:06:26.581778 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:26.581739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj" event={"ID":"e4d49938-0fce-4525-9b32-d938d9c812d4","Type":"ContainerStarted","Data":"cf50256eba5c09e4748491e3e3a57850360aaf952a881fe52e0b533e272cbb29"}
Jul 23 15:06:26.582280 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:26.581825    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:26.604726 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:26.604609    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj" podStartSLOduration=1.592636541 podStartE2EDuration="4.604586782s" totalImagesPullingTime="3.011950241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:06:26.602077685 +0000 UTC m=+371.316009625" watchObservedRunningTime="2026-07-23 15:06:26.604586782 +0000 UTC m=+371.318518723"
Jul 23 15:06:26.861191 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:26.861088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:28.593261 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:28.593154    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv" event={"ID":"d2f83c07-b383-4d6b-87ec-8343ac14a6a3","Type":"ContainerStarted","Data":"d7c7a433d5d94d0aab6470684118654af106eb5cb862707ed36e03853b5b4947"}
Jul 23 15:06:28.612710 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:28.612656    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2shsv" podStartSLOduration=1.674627782 podStartE2EDuration="5.612635178s" totalImagesPullingTime="3.938007396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:06:28.611774693 +0000 UTC m=+373.325706629" watchObservedRunningTime="2026-07-23 15:06:28.612635178 +0000 UTC m=+373.326567114"
Jul 23 15:06:29.364858 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:29.364819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:29.469280 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:29.469247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:31.206375 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:31.206329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:32.589270 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:32.589239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tqhcj"
Jul 23 15:06:42.719464 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:42.719423    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:42.796688 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:42.796652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:47.122255 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:47.122218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:47.217091 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:47.217052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:47.802634 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:47.802590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:48.179694 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.179619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:48.276652 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.276625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:48.317325 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.317294    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"]
Jul 23 15:06:48.322318 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.322300    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.325200 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.325182    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 15:06:48.325513 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.325497    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 15:06:48.325705 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.325693    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zbq89\""
Jul 23 15:06:48.325945 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.325929    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 15:06:48.326604 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.326590    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 15:06:48.333082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.333055    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"]
Jul 23 15:06:48.454633 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.454534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-tmp\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.454633 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.454574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-manifests\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.454867 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.454694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.454867 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.454744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-webhook-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.454867 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.454774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hq2b\" (UniqueName: \"kubernetes.io/projected/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-kube-api-access-4hq2b\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.555621 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.555584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-webhook-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.555621 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.555621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hq2b\" (UniqueName: \"kubernetes.io/projected/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-kube-api-access-4hq2b\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.555871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.555760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-tmp\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.555871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.555807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-manifests\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.555980 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.555910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.556249 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.556228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-manifests\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.558020 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.557987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-tmp\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.558153 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.558117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-webhook-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.558247 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.558229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.576644 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.576616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hq2b\" (UniqueName: \"kubernetes.io/projected/05244e10-0a6e-4c15-8e6c-d66fbbe2097b-kube-api-access-4hq2b\") pod \"opendatahub-operator-controller-manager-75984d86c4-j9rf2\" (UID: \"05244e10-0a6e-4c15-8e6c-d66fbbe2097b\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.593692 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.593658    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:48.632684 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.632651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:48.700034 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.699996    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:48.793712 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.793684    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"]
Jul 23 15:06:48.796001 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:06:48.795974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05244e10_0a6e_4c15_8e6c_d66fbbe2097b.slice/crio-b5cf837e153c49c8769748ed924b22c8f3ea39f747f4233f57c64956f634e8a8 WatchSource:0}: Error finding container b5cf837e153c49c8769748ed924b22c8f3ea39f747f4233f57c64956f634e8a8: Status 404 returned error can't find the container with id b5cf837e153c49c8769748ed924b22c8f3ea39f747f4233f57c64956f634e8a8
Jul 23 15:06:48.802916 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.802885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:48.908709 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:48.908654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:49.004589 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:49.004499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:49.106857 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:49.106819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:49.205619 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:49.205583    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:49.684154 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:49.684108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2" event={"ID":"05244e10-0a6e-4c15-8e6c-d66fbbe2097b","Type":"ContainerStarted","Data":"b5cf837e153c49c8769748ed924b22c8f3ea39f747f4233f57c64956f634e8a8"}
Jul 23 15:06:51.537275 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:51.537237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:51.638206 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:51.638153    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:52.698898 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:52.698861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2" event={"ID":"05244e10-0a6e-4c15-8e6c-d66fbbe2097b","Type":"ContainerStarted","Data":"f8254a9caa3ec17b793940854b49b6b4294ac038cca18c23fca73418fa8472dd"}
Jul 23 15:06:52.836319 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:52.836284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:52.936619 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:52.936576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:06:53.704626 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:53.704588    2575 generic.go:356] "Generic (PLEG): container finished" podID="05244e10-0a6e-4c15-8e6c-d66fbbe2097b" containerID="f8254a9caa3ec17b793940854b49b6b4294ac038cca18c23fca73418fa8472dd" exitCode=0
Jul 23 15:06:53.705065 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:53.704674    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2" event={"ID":"05244e10-0a6e-4c15-8e6c-d66fbbe2097b","Type":"ContainerDied","Data":"f8254a9caa3ec17b793940854b49b6b4294ac038cca18c23fca73418fa8472dd"}
Jul 23 15:06:54.711087 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:54.711044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2" event={"ID":"05244e10-0a6e-4c15-8e6c-d66fbbe2097b","Type":"ContainerStarted","Data":"7e8009e4d82a38d13989ffa9f6f442d0c03a135490f689bef3584737990cf58f"}
Jul 23 15:06:54.711526 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:54.711165    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:06:54.741745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:06:54.741693    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2" podStartSLOduration=1.958683454 podStartE2EDuration="6.741677025s" totalImagesPullingTime="3.698139781s" totalInitContainerRuntime="1.08485379s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:06:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:06:54.739996713 +0000 UTC m=+399.453928651" watchObservedRunningTime="2026-07-23 15:06:54.741677025 +0000 UTC m=+399.455608961"
Jul 23 15:07:05.718072 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:05.718041    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-j9rf2"
Jul 23 15:07:07.540024 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:07.539987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:07.759129 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:07.759097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:08.271885 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.271851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:08.472446 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.472409    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-848d77456-sx4qd"]
Jul 23 15:07:08.480794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.480767    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.484023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.483994    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pd9hw\""
Jul 23 15:07:08.484023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.484022    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 15:07:08.487063 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.487041    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 15:07:08.491573 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.491549    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-848d77456-sx4qd"]
Jul 23 15:07:08.533488 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.533400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggz9\" (UniqueName: \"kubernetes.io/projected/56ce4de6-7d37-46f6-b89e-265e335ad01c-kube-api-access-hggz9\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.533488 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.533437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56ce4de6-7d37-46f6-b89e-265e335ad01c-tls-certs\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.533665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.533517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ce4de6-7d37-46f6-b89e-265e335ad01c-tmp\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.634843 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.634807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggz9\" (UniqueName: \"kubernetes.io/projected/56ce4de6-7d37-46f6-b89e-265e335ad01c-kube-api-access-hggz9\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.634843 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.634847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56ce4de6-7d37-46f6-b89e-265e335ad01c-tls-certs\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.635288 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.634965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ce4de6-7d37-46f6-b89e-265e335ad01c-tmp\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.635288 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:07:08.635018    2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 23 15:07:08.635288 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:07:08.635081    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ce4de6-7d37-46f6-b89e-265e335ad01c-tls-certs podName:56ce4de6-7d37-46f6-b89e-265e335ad01c nodeName:}" failed. No retries permitted until 2026-07-23 15:07:09.135063114 +0000 UTC m=+413.848995032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/56ce4de6-7d37-46f6-b89e-265e335ad01c-tls-certs") pod "kube-auth-proxy-848d77456-sx4qd" (UID: "56ce4de6-7d37-46f6-b89e-265e335ad01c") : secret "kube-auth-proxy-tls" not found
Jul 23 15:07:08.637258 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.637236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ce4de6-7d37-46f6-b89e-265e335ad01c-tmp\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.648274 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.648254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggz9\" (UniqueName: \"kubernetes.io/projected/56ce4de6-7d37-46f6-b89e-265e335ad01c-kube-api-access-hggz9\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:08.936840 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:08.936807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:09.016828 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.016790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:09.121306 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.121254    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:09.140102 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.140075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56ce4de6-7d37-46f6-b89e-265e335ad01c-tls-certs\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:09.142595 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.142570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56ce4de6-7d37-46f6-b89e-265e335ad01c-tls-certs\") pod \"kube-auth-proxy-848d77456-sx4qd\" (UID: \"56ce4de6-7d37-46f6-b89e-265e335ad01c\") " pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:09.391025 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.390925    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd"
Jul 23 15:07:09.604768 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.604730    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-848d77456-sx4qd"]
Jul 23 15:07:09.608641 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:07:09.608603    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ce4de6_7d37_46f6_b89e_265e335ad01c.slice/crio-a7080d10be80add2ddf403191a64cf61fb1373bd16ecb5c4ada2f62f4070d3e1 WatchSource:0}: Error finding container a7080d10be80add2ddf403191a64cf61fb1373bd16ecb5c4ada2f62f4070d3e1: Status 404 returned error can't find the container with id a7080d10be80add2ddf403191a64cf61fb1373bd16ecb5c4ada2f62f4070d3e1
Jul 23 15:07:09.775333 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.775296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd" event={"ID":"56ce4de6-7d37-46f6-b89e-265e335ad01c","Type":"ContainerStarted","Data":"a7080d10be80add2ddf403191a64cf61fb1373bd16ecb5c4ada2f62f4070d3e1"}
Jul 23 15:07:09.879143 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:09.879106    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:10.133950 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:10.133867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:10.532735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:10.532702    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:10.829593 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:10.829511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:10.926788 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:10.926754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:12.623575 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:12.623481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:12.791070 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:12.791036    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd" event={"ID":"56ce4de6-7d37-46f6-b89e-265e335ad01c","Type":"ContainerStarted","Data":"b708e7923678de678b516f0c3536528c4347d213140ec4d53953b34799278f92"}
Jul 23 15:07:12.827773 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:12.827600    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-848d77456-sx4qd" podStartSLOduration=2.114831312 podStartE2EDuration="4.827582423s" totalImagesPullingTime="2.712751111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:07:12.827527167 +0000 UTC m=+417.541459103" watchObservedRunningTime="2026-07-23 15:07:12.827582423 +0000 UTC m=+417.541514360"
Jul 23 15:07:15.944009 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.943980    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"]
Jul 23 15:07:15.948831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.948800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:15.953055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.953034    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 15:07:15.953208 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.953071    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 15:07:15.953276 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.953253    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 15:07:15.953752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.953738    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 15:07:15.953819 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.953782    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-k2f8h\""
Jul 23 15:07:15.971212 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:15.971188    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"]
Jul 23 15:07:16.002045 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.002012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.002217 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.002051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.002217 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.002079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.002217 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.002162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.002332 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.002243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.002332 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.002263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88ksl\" (UniqueName: \"kubernetes.io/projected/a13bd47f-82f4-4806-9c3a-40045f2d7a18-kube-api-access-88ksl\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.002332 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.002295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13bd47f-82f4-4806-9c3a-40045f2d7a18-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.103803 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.103769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.103983 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.103810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.103983 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.103831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.103983 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.103868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.103983 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.103897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.103983 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.103916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88ksl\" (UniqueName: \"kubernetes.io/projected/a13bd47f-82f4-4806-9c3a-40045f2d7a18-kube-api-access-88ksl\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.104219 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.104088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13bd47f-82f4-4806-9c3a-40045f2d7a18-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.104581 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.104553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.106313 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.106287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.106313 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.106299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.106599 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.106581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13bd47f-82f4-4806-9c3a-40045f2d7a18-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.106664 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.106631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.123549 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.123525    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13bd47f-82f4-4806-9c3a-40045f2d7a18-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.123750 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.123725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88ksl\" (UniqueName: \"kubernetes.io/projected/a13bd47f-82f4-4806-9c3a-40045f2d7a18-kube-api-access-88ksl\") pod \"istiod-openshift-gateway-94bb8fbfd-dbkdk\" (UID: \"a13bd47f-82f4-4806-9c3a-40045f2d7a18\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.258141 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.258053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:16.397995 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.397809    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"]
Jul 23 15:07:16.400467 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:07:16.400438    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13bd47f_82f4_4806_9c3a_40045f2d7a18.slice/crio-c1c7a18df223183332186616c1ae4a502a0538579d8e2609f5147f745de593d4 WatchSource:0}: Error finding container c1c7a18df223183332186616c1ae4a502a0538579d8e2609f5147f745de593d4: Status 404 returned error can't find the container with id c1c7a18df223183332186616c1ae4a502a0538579d8e2609f5147f745de593d4
Jul 23 15:07:16.813798 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:16.813761    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk" event={"ID":"a13bd47f-82f4-4806-9c3a-40045f2d7a18","Type":"ContainerStarted","Data":"c1c7a18df223183332186616c1ae4a502a0538579d8e2609f5147f745de593d4"}
Jul 23 15:07:17.313531 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:17.313489    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:17.432893 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:17.432858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:18.611602 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:18.611566    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:07:18.611907 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:18.611635    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:07:18.824326 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:18.824291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk" event={"ID":"a13bd47f-82f4-4806-9c3a-40045f2d7a18","Type":"ContainerStarted","Data":"90abe6d8d167f358e1d416b225b43565894a83a19f6e710b0209ae65864a1eda"}
Jul 23 15:07:18.824498 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:18.824428    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:18.884329 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:18.884215    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk" podStartSLOduration=1.675486551 podStartE2EDuration="3.88419593s" totalImagesPullingTime="2.208709379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:07:18.883609508 +0000 UTC m=+423.597541464" watchObservedRunningTime="2026-07-23 15:07:18.88419593 +0000 UTC m=+423.598127863"
Jul 23 15:07:18.986626 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:18.986586    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:19.087706 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:19.087669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:19.296455 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:19.296410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:19.830810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:19.830774    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-dbkdk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 15:07:19.831208 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:19.830844    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk" podUID="a13bd47f-82f4-4806-9c3a-40045f2d7a18" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 15:07:20.841932 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:20.841901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:20.993065 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:20.993034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:21.080469 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.080431    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"]
Jul 23 15:07:21.083898 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.083880    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.088246 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.088219    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 15:07:21.088246 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.088245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-c8zj6\""
Jul 23 15:07:21.089604 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.089579    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"]
Jul 23 15:07:21.092842 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.092784    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.096546 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.096524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-x4xbw\""
Jul 23 15:07:21.097119 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.097088    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 15:07:21.116063 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.116030    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"]
Jul 23 15:07:21.117547 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.117528    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"]
Jul 23 15:07:21.134362 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.134335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:21.150610 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.150585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0159cee4-06fd-4133-bdba-33b1ebb83327-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhr95\" (UID: \"0159cee4-06fd-4133-bdba-33b1ebb83327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.150759 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.150645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2r9b\" (UniqueName: \"kubernetes.io/projected/0159cee4-06fd-4133-bdba-33b1ebb83327-kube-api-access-c2r9b\") pod \"llmisvc-controller-manager-777c6bd7d5-dhr95\" (UID: \"0159cee4-06fd-4133-bdba-33b1ebb83327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.150759 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.150677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggbkn\" (UniqueName: \"kubernetes.io/projected/60fe861d-4b7b-4975-832d-ab3923f4f89d-kube-api-access-ggbkn\") pod \"kserve-controller-manager-d6f4b65b8-7qcfr\" (UID: \"60fe861d-4b7b-4975-832d-ab3923f4f89d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.150831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.150750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60fe861d-4b7b-4975-832d-ab3923f4f89d-cert\") pod \"kserve-controller-manager-d6f4b65b8-7qcfr\" (UID: \"60fe861d-4b7b-4975-832d-ab3923f4f89d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.251839 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.251791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2r9b\" (UniqueName: \"kubernetes.io/projected/0159cee4-06fd-4133-bdba-33b1ebb83327-kube-api-access-c2r9b\") pod \"llmisvc-controller-manager-777c6bd7d5-dhr95\" (UID: \"0159cee4-06fd-4133-bdba-33b1ebb83327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.251839 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.251837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggbkn\" (UniqueName: \"kubernetes.io/projected/60fe861d-4b7b-4975-832d-ab3923f4f89d-kube-api-access-ggbkn\") pod \"kserve-controller-manager-d6f4b65b8-7qcfr\" (UID: \"60fe861d-4b7b-4975-832d-ab3923f4f89d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.252116 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.251878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60fe861d-4b7b-4975-832d-ab3923f4f89d-cert\") pod \"kserve-controller-manager-d6f4b65b8-7qcfr\" (UID: \"60fe861d-4b7b-4975-832d-ab3923f4f89d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.252116 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.251899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0159cee4-06fd-4133-bdba-33b1ebb83327-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhr95\" (UID: \"0159cee4-06fd-4133-bdba-33b1ebb83327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.252116 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:07:21.251987    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 15:07:21.252116 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:07:21.252041    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 15:07:21.252116 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:07:21.252048    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0159cee4-06fd-4133-bdba-33b1ebb83327-cert podName:0159cee4-06fd-4133-bdba-33b1ebb83327 nodeName:}" failed. No retries permitted until 2026-07-23 15:07:21.752032882 +0000 UTC m=+426.465964797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0159cee4-06fd-4133-bdba-33b1ebb83327-cert") pod "llmisvc-controller-manager-777c6bd7d5-dhr95" (UID: "0159cee4-06fd-4133-bdba-33b1ebb83327") : secret "llmisvc-webhook-server-cert" not found
Jul 23 15:07:21.252116 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:07:21.252116    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60fe861d-4b7b-4975-832d-ab3923f4f89d-cert podName:60fe861d-4b7b-4975-832d-ab3923f4f89d nodeName:}" failed. No retries permitted until 2026-07-23 15:07:21.752098768 +0000 UTC m=+426.466030696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60fe861d-4b7b-4975-832d-ab3923f4f89d-cert") pod "kserve-controller-manager-d6f4b65b8-7qcfr" (UID: "60fe861d-4b7b-4975-832d-ab3923f4f89d") : secret "kserve-webhook-server-cert" not found
Jul 23 15:07:21.295422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.295384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggbkn\" (UniqueName: \"kubernetes.io/projected/60fe861d-4b7b-4975-832d-ab3923f4f89d-kube-api-access-ggbkn\") pod \"kserve-controller-manager-d6f4b65b8-7qcfr\" (UID: \"60fe861d-4b7b-4975-832d-ab3923f4f89d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.295571 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.295384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2r9b\" (UniqueName: \"kubernetes.io/projected/0159cee4-06fd-4133-bdba-33b1ebb83327-kube-api-access-c2r9b\") pod \"llmisvc-controller-manager-777c6bd7d5-dhr95\" (UID: \"0159cee4-06fd-4133-bdba-33b1ebb83327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.390313 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.390183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:21.490079 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.490025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:21.757303 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.757259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60fe861d-4b7b-4975-832d-ab3923f4f89d-cert\") pod \"kserve-controller-manager-d6f4b65b8-7qcfr\" (UID: \"60fe861d-4b7b-4975-832d-ab3923f4f89d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.757500 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.757347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0159cee4-06fd-4133-bdba-33b1ebb83327-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhr95\" (UID: \"0159cee4-06fd-4133-bdba-33b1ebb83327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.759744 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.759717    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60fe861d-4b7b-4975-832d-ab3923f4f89d-cert\") pod \"kserve-controller-manager-d6f4b65b8-7qcfr\" (UID: \"60fe861d-4b7b-4975-832d-ab3923f4f89d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:21.759881 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.759728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0159cee4-06fd-4133-bdba-33b1ebb83327-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhr95\" (UID: \"0159cee4-06fd-4133-bdba-33b1ebb83327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:21.993652 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:21.993599    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:22.002161 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.002132    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:22.157708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.157663    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"]
Jul 23 15:07:22.164215 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:07:22.164183    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0159cee4_06fd_4133_bdba_33b1ebb83327.slice/crio-9fa9e91f9f5ecb40187bc54c4ecb0601a977627841300d0abf700815fc2f1376 WatchSource:0}: Error finding container 9fa9e91f9f5ecb40187bc54c4ecb0601a977627841300d0abf700815fc2f1376: Status 404 returned error can't find the container with id 9fa9e91f9f5ecb40187bc54c4ecb0601a977627841300d0abf700815fc2f1376
Jul 23 15:07:22.178960 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.178935    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"]
Jul 23 15:07:22.182631 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:07:22.182609    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fe861d_4b7b_4975_832d_ab3923f4f89d.slice/crio-663a4166453852a636bafe3a3de918bf5e7fef406940b09298030b6eba8d0417 WatchSource:0}: Error finding container 663a4166453852a636bafe3a3de918bf5e7fef406940b09298030b6eba8d0417: Status 404 returned error can't find the container with id 663a4166453852a636bafe3a3de918bf5e7fef406940b09298030b6eba8d0417
Jul 23 15:07:22.298672 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.298591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:22.395407 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.395371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:22.515607 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.515567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:07:22.830346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.830310    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dbkdk"
Jul 23 15:07:22.842638 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.842604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95" event={"ID":"0159cee4-06fd-4133-bdba-33b1ebb83327","Type":"ContainerStarted","Data":"9fa9e91f9f5ecb40187bc54c4ecb0601a977627841300d0abf700815fc2f1376"}
Jul 23 15:07:22.844005 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:22.843975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr" event={"ID":"60fe861d-4b7b-4975-832d-ab3923f4f89d","Type":"ContainerStarted","Data":"663a4166453852a636bafe3a3de918bf5e7fef406940b09298030b6eba8d0417"}
Jul 23 15:07:25.865143 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:25.865108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95" event={"ID":"0159cee4-06fd-4133-bdba-33b1ebb83327","Type":"ContainerStarted","Data":"c88cc9f0f3c74f960755e5dce8f9ca8aace35c5849123007efc21f6bd4fc3386"}
Jul 23 15:07:25.865540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:25.865162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:07:25.865540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:25.865202    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:25.865540 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:25.865223    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr" event={"ID":"60fe861d-4b7b-4975-832d-ab3923f4f89d","Type":"ContainerStarted","Data":"b227b3d6504a62bfa134517b1a6ec88d0c59981d2f9a738212fc3ab660240ef3"}
Jul 23 15:07:25.893305 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:25.893251    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95" podStartSLOduration=1.5956661429999999 podStartE2EDuration="4.893234567s" totalImagesPullingTime="3.297568424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:07:25.889972926 +0000 UTC m=+430.603904863" watchObservedRunningTime="2026-07-23 15:07:25.893234567 +0000 UTC m=+430.607166504"
Jul 23 15:07:25.932584 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:25.932529    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr" podStartSLOduration=1.71112602 podStartE2EDuration="4.932511933s" totalImagesPullingTime="3.221385913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:07:25.931359005 +0000 UTC m=+430.645290992" watchObservedRunningTime="2026-07-23 15:07:25.932511933 +0000 UTC m=+430.646443869"
Jul 23 15:07:56.872773 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:56.872740    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7qcfr"
Jul 23 15:07:57.873404 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:07:57.873375    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhr95"
Jul 23 15:08:09.269479 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:09.269443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:09.428228 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:09.428195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:09.533504 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:09.533425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:25.705951 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:25.705912    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:36.825603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.825565    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c5596656-4lmz5"]
Jul 23 15:08:36.828935 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.828911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.834562 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.834528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrd7\" (UniqueName: \"kubernetes.io/projected/724d5a5f-8253-4037-b8a3-4d2e440c75b1-kube-api-access-5wrd7\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.834686 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.834596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-serving-cert\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.834686 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.834621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-oauth-config\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.834782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.834689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-service-ca\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.834782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.834719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-config\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.834782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.834735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-trusted-ca-bundle\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.834782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.834762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-oauth-serving-cert\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.879878 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.879844    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5596656-4lmz5"]
Jul 23 15:08:36.935136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935102    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:36.935136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrd7\" (UniqueName: \"kubernetes.io/projected/724d5a5f-8253-4037-b8a3-4d2e440c75b1-kube-api-access-5wrd7\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.935395 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-serving-cert\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.935395 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-oauth-config\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.935660 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-service-ca\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.935846 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-config\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.935959 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-trusted-ca-bundle\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.935959 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.935912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-oauth-serving-cert\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.936461 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.936437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-service-ca\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.936629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.936603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-oauth-serving-cert\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.936738 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.936715    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-trusted-ca-bundle\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.936905 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.936888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-config\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.937900 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.937876    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-oauth-config\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.938268 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.938248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/724d5a5f-8253-4037-b8a3-4d2e440c75b1-console-serving-cert\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:36.950411 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:36.950389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrd7\" (UniqueName: \"kubernetes.io/projected/724d5a5f-8253-4037-b8a3-4d2e440c75b1-kube-api-access-5wrd7\") pod \"console-5c5596656-4lmz5\" (UID: \"724d5a5f-8253-4037-b8a3-4d2e440c75b1\") " pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:37.102782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:37.102700    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:37.138685 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:37.138648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:37.232559 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:37.232520    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:37.283299 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:37.283274    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5596656-4lmz5"]
Jul 23 15:08:37.285342 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:08:37.285315    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724d5a5f_8253_4037_b8a3_4d2e440c75b1.slice/crio-287aa918126acdb578c14fbff17dd69ddec6f8f61f43c589abe6ab6ebf8cb3fa WatchSource:0}: Error finding container 287aa918126acdb578c14fbff17dd69ddec6f8f61f43c589abe6ab6ebf8cb3fa: Status 404 returned error can't find the container with id 287aa918126acdb578c14fbff17dd69ddec6f8f61f43c589abe6ab6ebf8cb3fa
Jul 23 15:08:37.647862 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:37.647831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:37.811146 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:37.811112    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:38.185650 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:38.185618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5596656-4lmz5" event={"ID":"724d5a5f-8253-4037-b8a3-4d2e440c75b1","Type":"ContainerStarted","Data":"2dc0675c611c7255fb114fb46c9320be4a38428b26eaf44957b15c7dad26ea99"}
Jul 23 15:08:38.186162 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:38.185664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5596656-4lmz5" event={"ID":"724d5a5f-8253-4037-b8a3-4d2e440c75b1","Type":"ContainerStarted","Data":"287aa918126acdb578c14fbff17dd69ddec6f8f61f43c589abe6ab6ebf8cb3fa"}
Jul 23 15:08:38.222628 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:38.222576    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c5596656-4lmz5" podStartSLOduration=2.222558302 podStartE2EDuration="2.222558302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:08:38.22237631 +0000 UTC m=+502.936308247" watchObservedRunningTime="2026-07-23 15:08:38.222558302 +0000 UTC m=+502.936490239"
Jul 23 15:08:39.196582 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:39.196547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:39.519418 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:39.519330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:40.216838 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:40.216803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:43.400462 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:43.400428    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:43.560335 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:43.560301    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:43.690489 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:43.690455    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:44.497368 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:44.497332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:46.603132 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.603095    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"]
Jul 23 15:08:46.606604 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.606586    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"
Jul 23 15:08:46.609902 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.609876    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 15:08:46.611149 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.611127    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7wwds\""
Jul 23 15:08:46.611149 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.611127    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 15:08:46.611149 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.611132    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 15:08:46.619927 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.619902    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"]
Jul 23 15:08:46.720494 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.720454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4q42\" (UniqueName: \"kubernetes.io/projected/5e692fb4-d75b-493a-9665-ecb963b39fb3-kube-api-access-z4q42\") pod \"dns-operator-controller-manager-864dd78c4c-7d547\" (UID: \"5e692fb4-d75b-493a-9665-ecb963b39fb3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"
Jul 23 15:08:46.821787 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.821743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4q42\" (UniqueName: \"kubernetes.io/projected/5e692fb4-d75b-493a-9665-ecb963b39fb3-kube-api-access-z4q42\") pod \"dns-operator-controller-manager-864dd78c4c-7d547\" (UID: \"5e692fb4-d75b-493a-9665-ecb963b39fb3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"
Jul 23 15:08:46.833835 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.833805    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4q42\" (UniqueName: \"kubernetes.io/projected/5e692fb4-d75b-493a-9665-ecb963b39fb3-kube-api-access-z4q42\") pod \"dns-operator-controller-manager-864dd78c4c-7d547\" (UID: \"5e692fb4-d75b-493a-9665-ecb963b39fb3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"
Jul 23 15:08:46.917284 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:46.917252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"
Jul 23 15:08:47.097512 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.097480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"]
Jul 23 15:08:47.100766 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:08:47.100740    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e692fb4_d75b_493a_9665_ecb963b39fb3.slice/crio-90f1662e6e4a045c137a431858dd9e24c0d3a8398d4e194c44dd0983657c919b WatchSource:0}: Error finding container 90f1662e6e4a045c137a431858dd9e24c0d3a8398d4e194c44dd0983657c919b: Status 404 returned error can't find the container with id 90f1662e6e4a045c137a431858dd9e24c0d3a8398d4e194c44dd0983657c919b
Jul 23 15:08:47.139323 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.139291    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:47.139505 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.139341    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:47.144145 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.144124    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:47.228231 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.228134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547" event={"ID":"5e692fb4-d75b-493a-9665-ecb963b39fb3","Type":"ContainerStarted","Data":"90f1662e6e4a045c137a431858dd9e24c0d3a8398d4e194c44dd0983657c919b"}
Jul 23 15:08:47.232180 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.232147    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c5596656-4lmz5"
Jul 23 15:08:47.367107 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.367075    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6947c47dd6-g9gmx"]
Jul 23 15:08:47.688604 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.688572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:47.835498 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.835451    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:47.973595 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:47.973508    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:48.571136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:48.571102    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:49.884959 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:49.884930    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"]
Jul 23 15:08:49.888157 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:49.888142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:08:49.892746 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:49.892727    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wfb87\""
Jul 23 15:08:49.912611 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:49.912584    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"]
Jul 23 15:08:49.951045 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:49.951015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh7rk\" (UniqueName: \"kubernetes.io/projected/3ad08a07-6f2d-4562-a36d-72b6b12d54ba-kube-api-access-wh7rk\") pod \"limitador-operator-controller-manager-859d7b78bd-6t89z\" (UID: \"3ad08a07-6f2d-4562-a36d-72b6b12d54ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:08:50.052418 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.052378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh7rk\" (UniqueName: \"kubernetes.io/projected/3ad08a07-6f2d-4562-a36d-72b6b12d54ba-kube-api-access-wh7rk\") pod \"limitador-operator-controller-manager-859d7b78bd-6t89z\" (UID: \"3ad08a07-6f2d-4562-a36d-72b6b12d54ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:08:50.067126 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.067094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh7rk\" (UniqueName: \"kubernetes.io/projected/3ad08a07-6f2d-4562-a36d-72b6b12d54ba-kube-api-access-wh7rk\") pod \"limitador-operator-controller-manager-859d7b78bd-6t89z\" (UID: \"3ad08a07-6f2d-4562-a36d-72b6b12d54ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:08:50.198906 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.198871    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:08:50.244834 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.244797    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547" event={"ID":"5e692fb4-d75b-493a-9665-ecb963b39fb3","Type":"ContainerStarted","Data":"78e1e5cc67695e3b64baf340b1119c260b2ae7be46b6ae53dc2ec953d0f7c162"}
Jul 23 15:08:50.244996 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.244892    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"
Jul 23 15:08:50.340558 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.340503    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547" podStartSLOduration=2.255881234 podStartE2EDuration="4.340484158s" totalImagesPullingTime="2.084602924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:08:50.272519763 +0000 UTC m=+514.986451703" watchObservedRunningTime="2026-07-23 15:08:50.340484158 +0000 UTC m=+515.054416095"
Jul 23 15:08:50.341596 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.341573    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"]
Jul 23 15:08:50.343949 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:08:50.343921    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad08a07_6f2d_4562_a36d_72b6b12d54ba.slice/crio-5822c7203af7511e175faff1ab241a3f9174affe963c41be0991e0cf13fe9765 WatchSource:0}: Error finding container 5822c7203af7511e175faff1ab241a3f9174affe963c41be0991e0cf13fe9765: Status 404 returned error can't find the container with id 5822c7203af7511e175faff1ab241a3f9174affe963c41be0991e0cf13fe9765
Jul 23 15:08:50.505949 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.505863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:50.960561 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:50.960530    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:51.251050 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:51.250962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z" event={"ID":"3ad08a07-6f2d-4562-a36d-72b6b12d54ba","Type":"ContainerStarted","Data":"5822c7203af7511e175faff1ab241a3f9174affe963c41be0991e0cf13fe9765"}
Jul 23 15:08:53.263573 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:53.263528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z" event={"ID":"3ad08a07-6f2d-4562-a36d-72b6b12d54ba","Type":"ContainerStarted","Data":"a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8"}
Jul 23 15:08:53.263992 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:53.263633    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:08:53.298352 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:53.298302    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z" podStartSLOduration=1.879766407 podStartE2EDuration="4.298283796s" totalImagesPullingTime="2.418517389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:08:53.297276077 +0000 UTC m=+518.011208013" watchObservedRunningTime="2026-07-23 15:08:53.298283796 +0000 UTC m=+518.012215732"
Jul 23 15:08:53.942913 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:53.942885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:55.678753 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:55.678718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:55.777433 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:55.777392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:56.066328 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:56.066249    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:56.165788 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:56.165755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:59.281908 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:59.281877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:08:59.388330 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:08:59.388299    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:01.253552 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:01.253517    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7d547"
Jul 23 15:09:01.629138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:01.629058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:01.769554 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:01.769522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:03.075408 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:03.075324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:03.177782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:03.177749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:03.495045 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:03.495009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:03.891025 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:03.890942    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:04.270151 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:04.270115    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:06.464684 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:06.464638    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:06.552928 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:06.552894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:12.387309 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.387225    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6947c47dd6-g9gmx" podUID="e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" containerName="console" containerID="cri-o://447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762" gracePeriod=15
Jul 23 15:09:12.633133 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.633108    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:09:12.754939 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.754896    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-trusted-ca-bundle\") pod \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") "
Jul 23 15:09:12.755125 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.754949    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhctb\" (UniqueName: \"kubernetes.io/projected/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-kube-api-access-xhctb\") pod \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") "
Jul 23 15:09:12.755125 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.754991    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-service-ca\") pod \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") "
Jul 23 15:09:12.755125 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755093    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-serving-cert\") pod \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") "
Jul 23 15:09:12.755302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755142    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-config\") pod \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") "
Jul 23 15:09:12.755302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755162    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-oauth-config\") pod \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") "
Jul 23 15:09:12.755302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755235    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-oauth-serving-cert\") pod \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\" (UID: \"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c\") "
Jul 23 15:09:12.755467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755384    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" (UID: "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:09:12.755467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" (UID: "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:09:12.755637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755607    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-config" (OuterVolumeSpecName: "console-config") pod "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" (UID: "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:09:12.755701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755668    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-trusted-ca-bundle\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:12.755701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755686    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:12.755701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.755691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" (UID: "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:09:12.757398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.757373    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" (UID: "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:09:12.757714 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.757692    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-kube-api-access-xhctb" (OuterVolumeSpecName: "kube-api-access-xhctb") pod "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" (UID: "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c"). InnerVolumeSpecName "kube-api-access-xhctb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:09:12.757714 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.757703    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" (UID: "e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:09:12.856134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.856097    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-oauth-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:12.856134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.856128    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhctb\" (UniqueName: \"kubernetes.io/projected/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-kube-api-access-xhctb\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:12.856134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.856138    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-serving-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:12.856400 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.856149    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:12.856400 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:12.856158    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c-console-oauth-config\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:13.208837 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.208800    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"]
Jul 23 15:09:13.209160 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.209148    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" containerName="console"
Jul 23 15:09:13.209238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.209162    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" containerName="console"
Jul 23 15:09:13.209274 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.209241    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" containerName="console"
Jul 23 15:09:13.228288 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.228248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.230985 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.230958    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"]
Jul 23 15:09:13.231712 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.231686    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cddmh\""
Jul 23 15:09:13.356075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.356037    2575 generic.go:356] "Generic (PLEG): container finished" podID="e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" containerID="447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762" exitCode=0
Jul 23 15:09:13.356295 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.356093    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6947c47dd6-g9gmx"
Jul 23 15:09:13.356295 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.356119    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6947c47dd6-g9gmx" event={"ID":"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c","Type":"ContainerDied","Data":"447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762"}
Jul 23 15:09:13.356295 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.356164    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6947c47dd6-g9gmx" event={"ID":"e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c","Type":"ContainerDied","Data":"4d35697692899e710e9f0db7d439809a9586781a50394451f871e1a5ea0c9e2f"}
Jul 23 15:09:13.356295 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.356195    2575 scope.go:117] "RemoveContainer" containerID="447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762"
Jul 23 15:09:13.360321 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.360301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/456d520e-43d3-4385-9356-3a2b9ab71ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.367151 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.360366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5khmc\" (UniqueName: \"kubernetes.io/projected/456d520e-43d3-4385-9356-3a2b9ab71ce1-kube-api-access-5khmc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.368237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.368210    2575 scope.go:117] "RemoveContainer" containerID="447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762"
Jul 23 15:09:13.368543 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:13.368519    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762\": container with ID starting with 447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762 not found: ID does not exist" containerID="447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762"
Jul 23 15:09:13.368638 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.368551    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762"} err="failed to get container status \"447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762\": rpc error: code = NotFound desc = could not find container \"447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762\": container with ID starting with 447d860134422adecd35030a3c28389a80ba86259f655c3b49596b3883387762 not found: ID does not exist"
Jul 23 15:09:13.385010 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.384979    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6947c47dd6-g9gmx"]
Jul 23 15:09:13.391786 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.391759    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6947c47dd6-g9gmx"]
Jul 23 15:09:13.462389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.462289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/456d520e-43d3-4385-9356-3a2b9ab71ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.462389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.462386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5khmc\" (UniqueName: \"kubernetes.io/projected/456d520e-43d3-4385-9356-3a2b9ab71ce1-kube-api-access-5khmc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.462690 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.462668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/456d520e-43d3-4385-9356-3a2b9ab71ce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.471804 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.471773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5khmc\" (UniqueName: \"kubernetes.io/projected/456d520e-43d3-4385-9356-3a2b9ab71ce1-kube-api-access-5khmc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.540243 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.540208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:13.687186 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.687137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"]
Jul 23 15:09:13.689962 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:09:13.689932    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456d520e_43d3_4385_9356_3a2b9ab71ce1.slice/crio-0263272e5e19162ea1d682db3a0026ef4c3f4a40c2d98d7065d4839942bc557f WatchSource:0}: Error finding container 0263272e5e19162ea1d682db3a0026ef4c3f4a40c2d98d7065d4839942bc557f: Status 404 returned error can't find the container with id 0263272e5e19162ea1d682db3a0026ef4c3f4a40c2d98d7065d4839942bc557f
Jul 23 15:09:13.866453 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.866378    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c" path="/var/lib/kubelet/pods/e4ae5a5b-a1b1-4be6-a8d9-4392d6ab626c/volumes"
Jul 23 15:09:13.921629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.921593    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"]
Jul 23 15:09:13.959427 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:13.959394    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"]
Jul 23 15:09:14.018544 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.018510    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"]
Jul 23 15:09:14.018741 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.018711    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" containerName="manager" containerID="cri-o://a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8" gracePeriod=2
Jul 23 15:09:14.029479 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.029387    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"]
Jul 23 15:09:14.134925 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.134899    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"]
Jul 23 15:09:14.135324 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.135309    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" containerName="manager"
Jul 23 15:09:14.135384 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.135327    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" containerName="manager"
Jul 23 15:09:14.135434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.135403    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" containerName="manager"
Jul 23 15:09:14.137578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.137560    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.143559 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:14.143527    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6t89z\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:14.148756 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.148729    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"]
Jul 23 15:09:14.151036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.151019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"
Jul 23 15:09:14.174764 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.174729    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"]
Jul 23 15:09:14.190055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.190018    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"]
Jul 23 15:09:14.251530 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:14.251489    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6t89z\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:14.270136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.270103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjfnl\" (UniqueName: \"kubernetes.io/projected/ffddd863-c5f2-4749-a98f-efec5d02598b-kube-api-access-xjfnl\") pod \"limitador-operator-controller-manager-859d7b78bd-jjx6m\" (UID: \"ffddd863-c5f2-4749-a98f-efec5d02598b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"
Jul 23 15:09:14.270306 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.270161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ssh5\" (UniqueName: \"kubernetes.io/projected/e103d74a-2f92-45ed-abc8-46a87439a42f-kube-api-access-5ssh5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crp98\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.270306 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.270247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e103d74a-2f92-45ed-abc8-46a87439a42f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crp98\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.274875 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.274852    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:14.336492 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:14.336447    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6t89z\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:14.369379 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.369334    2575 generic.go:356] "Generic (PLEG): container finished" podID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" containerID="a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8" exitCode=0
Jul 23 15:09:14.369578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.369397    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:14.369578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.369427    2575 scope.go:117] "RemoveContainer" containerID="a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8"
Jul 23 15:09:14.370715 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.370693    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh7rk\" (UniqueName: \"kubernetes.io/projected/3ad08a07-6f2d-4562-a36d-72b6b12d54ba-kube-api-access-wh7rk\") pod \"3ad08a07-6f2d-4562-a36d-72b6b12d54ba\" (UID: \"3ad08a07-6f2d-4562-a36d-72b6b12d54ba\") "
Jul 23 15:09:14.370896 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.370875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e103d74a-2f92-45ed-abc8-46a87439a42f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crp98\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.370990 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.370974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjfnl\" (UniqueName: \"kubernetes.io/projected/ffddd863-c5f2-4749-a98f-efec5d02598b-kube-api-access-xjfnl\") pod \"limitador-operator-controller-manager-859d7b78bd-jjx6m\" (UID: \"ffddd863-c5f2-4749-a98f-efec5d02598b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"
Jul 23 15:09:14.371066 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.371021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ssh5\" (UniqueName: \"kubernetes.io/projected/e103d74a-2f92-45ed-abc8-46a87439a42f-kube-api-access-5ssh5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crp98\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.371307 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.371281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e103d74a-2f92-45ed-abc8-46a87439a42f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crp98\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.373637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.373606    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad08a07-6f2d-4562-a36d-72b6b12d54ba-kube-api-access-wh7rk" (OuterVolumeSpecName: "kube-api-access-wh7rk") pod "3ad08a07-6f2d-4562-a36d-72b6b12d54ba" (UID: "3ad08a07-6f2d-4562-a36d-72b6b12d54ba"). InnerVolumeSpecName "kube-api-access-wh7rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:09:14.375390 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:14.375356    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6t89z\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:14.387221 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.387123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ssh5\" (UniqueName: \"kubernetes.io/projected/e103d74a-2f92-45ed-abc8-46a87439a42f-kube-api-access-5ssh5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-crp98\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.392705 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.392678    2575 scope.go:117] "RemoveContainer" containerID="a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8"
Jul 23 15:09:14.393152 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:14.393104    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8\": container with ID starting with a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8 not found: ID does not exist" containerID="a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8"
Jul 23 15:09:14.393232 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.393182    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8"} err="failed to get container status \"a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8\": rpc error: code = NotFound desc = could not find container \"a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8\": container with ID starting with a14720c991481fe270cb98cef343914605f77ff47a6ee11747c3d463166751e8 not found: ID does not exist"
Jul 23 15:09:14.395139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.395083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjfnl\" (UniqueName: \"kubernetes.io/projected/ffddd863-c5f2-4749-a98f-efec5d02598b-kube-api-access-xjfnl\") pod \"limitador-operator-controller-manager-859d7b78bd-jjx6m\" (UID: \"ffddd863-c5f2-4749-a98f-efec5d02598b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"
Jul 23 15:09:14.449498 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.449458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:14.461661 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.461625    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"
Jul 23 15:09:14.472456 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.472420    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh7rk\" (UniqueName: \"kubernetes.io/projected/3ad08a07-6f2d-4562-a36d-72b6b12d54ba-kube-api-access-wh7rk\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:14.694057 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:14.694003    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6t89z\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:14.807310 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.807286    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"]
Jul 23 15:09:14.815642 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:14.815619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"]
Jul 23 15:09:14.830590 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:09:14.830551    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode103d74a_2f92_45ed_abc8_46a87439a42f.slice/crio-5a2819a9da5a650078f4f05b45a802c26009270003f0c45326c95ccac826544c WatchSource:0}: Error finding container 5a2819a9da5a650078f4f05b45a802c26009270003f0c45326c95ccac826544c: Status 404 returned error can't find the container with id 5a2819a9da5a650078f4f05b45a802c26009270003f0c45326c95ccac826544c
Jul 23 15:09:14.831153 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:09:14.831128    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffddd863_c5f2_4749_a98f_efec5d02598b.slice/crio-00991330b39d2a84a598bd094ae296c97b901b80f3efbbf601c84fef2a7b7c1d WatchSource:0}: Error finding container 00991330b39d2a84a598bd094ae296c97b901b80f3efbbf601c84fef2a7b7c1d: Status 404 returned error can't find the container with id 00991330b39d2a84a598bd094ae296c97b901b80f3efbbf601c84fef2a7b7c1d
Jul 23 15:09:15.268183 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:15.268123    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.35:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 15:09:15.380525 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:15.380487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m" event={"ID":"ffddd863-c5f2-4749-a98f-efec5d02598b","Type":"ContainerStarted","Data":"9b14c043873e9f252cdf57acb76d4606835bc77174633715e66d3feba4ff3405"}
Jul 23 15:09:15.380714 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:15.380550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m" event={"ID":"ffddd863-c5f2-4749-a98f-efec5d02598b","Type":"ContainerStarted","Data":"00991330b39d2a84a598bd094ae296c97b901b80f3efbbf601c84fef2a7b7c1d"}
Jul 23 15:09:15.380714 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:15.380593    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"
Jul 23 15:09:15.381875 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:15.381852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98" event={"ID":"e103d74a-2f92-45ed-abc8-46a87439a42f","Type":"ContainerStarted","Data":"5a2819a9da5a650078f4f05b45a802c26009270003f0c45326c95ccac826544c"}
Jul 23 15:09:15.384502 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:15.384478    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6t89z\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:15.412147 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:15.412094    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m" podStartSLOduration=1.412074737 podStartE2EDuration="1.412074737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:09:15.40903297 +0000 UTC m=+540.122964926" watchObservedRunningTime="2026-07-23 15:09:15.412074737 +0000 UTC m=+540.126006675"
Jul 23 15:09:15.871872 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:15.871821    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6t89z\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6t89z"
Jul 23 15:09:15.874280 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:15.874197    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad08a07-6f2d-4562-a36d-72b6b12d54ba" path="/var/lib/kubelet/pods/3ad08a07-6f2d-4562-a36d-72b6b12d54ba/volumes"
Jul 23 15:09:17.609825 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:17.609789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:17.782871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:17.782812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:18.398711 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.398674    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98" event={"ID":"e103d74a-2f92-45ed-abc8-46a87439a42f","Type":"ContainerStarted","Data":"161c7bccfcca545095c4707596cc13575252d11f647866d4f19e8deffe0895eb"}
Jul 23 15:09:18.398896 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.398790    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:18.400389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.400359    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" containerName="manager" containerID="cri-o://adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc" gracePeriod=2
Jul 23 15:09:18.447375 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.447327    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98" podStartSLOduration=1.015099331 podStartE2EDuration="4.44731085s" totalImagesPullingTime="3.432211519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:09:18.443960342 +0000 UTC m=+543.157892305" watchObservedRunningTime="2026-07-23 15:09:18.44731085 +0000 UTC m=+543.161242787"
Jul 23 15:09:18.642733 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.642705    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:18.645352 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:18.645321    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:18.816517 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.816417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5khmc\" (UniqueName: \"kubernetes.io/projected/456d520e-43d3-4385-9356-3a2b9ab71ce1-kube-api-access-5khmc\") pod \"456d520e-43d3-4385-9356-3a2b9ab71ce1\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") "
Jul 23 15:09:18.816693 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.816548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/456d520e-43d3-4385-9356-3a2b9ab71ce1-extensions-socket-volume\") pod \"456d520e-43d3-4385-9356-3a2b9ab71ce1\" (UID: \"456d520e-43d3-4385-9356-3a2b9ab71ce1\") "
Jul 23 15:09:18.816830 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.816804    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/456d520e-43d3-4385-9356-3a2b9ab71ce1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "456d520e-43d3-4385-9356-3a2b9ab71ce1" (UID: "456d520e-43d3-4385-9356-3a2b9ab71ce1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:09:18.818489 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.818458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/456d520e-43d3-4385-9356-3a2b9ab71ce1-kube-api-access-5khmc" (OuterVolumeSpecName: "kube-api-access-5khmc") pod "456d520e-43d3-4385-9356-3a2b9ab71ce1" (UID: "456d520e-43d3-4385-9356-3a2b9ab71ce1"). InnerVolumeSpecName "kube-api-access-5khmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:09:18.917436 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.917394    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5khmc\" (UniqueName: \"kubernetes.io/projected/456d520e-43d3-4385-9356-3a2b9ab71ce1-kube-api-access-5khmc\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:18.917436 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:18.917427    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/456d520e-43d3-4385-9356-3a2b9ab71ce1-extensions-socket-volume\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:19.406271 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:19.406237    2575 generic.go:356] "Generic (PLEG): container finished" podID="456d520e-43d3-4385-9356-3a2b9ab71ce1" containerID="adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc" exitCode=2
Jul 23 15:09:19.406450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:19.406277    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:19.406450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:19.406339    2575 scope.go:117] "RemoveContainer" containerID="adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc"
Jul 23 15:09:19.409100 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:19.409075    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:19.415526 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:19.415508    2575 scope.go:117] "RemoveContainer" containerID="adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc"
Jul 23 15:09:19.415772 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:19.415754    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc\": container with ID starting with adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc not found: ID does not exist" containerID="adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc"
Jul 23 15:09:19.415837 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:19.415786    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc"} err="failed to get container status \"adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc\": rpc error: code = NotFound desc = could not find container \"adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc\": container with ID starting with adc9cfb097174ef1519edbc80447eb7826c93058287e280ef436672cbf2e47fc not found: ID does not exist"
Jul 23 15:09:19.417080 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:09:19.417059    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kbmjm\" is forbidden: User \"system:node:ip-10-0-142-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-206.ec2.internal' and this object" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kbmjm"
Jul 23 15:09:19.865926 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:19.865880    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" path="/var/lib/kubelet/pods/456d520e-43d3-4385-9356-3a2b9ab71ce1/volumes"
Jul 23 15:09:26.186484 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.186451    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"]
Jul 23 15:09:26.186906 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.186623    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98" podUID="e103d74a-2f92-45ed-abc8-46a87439a42f" containerName="manager" containerID="cri-o://161c7bccfcca545095c4707596cc13575252d11f647866d4f19e8deffe0895eb" gracePeriod=10
Jul 23 15:09:26.189013 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.188987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:26.389561 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.389531    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjx6m"
Jul 23 15:09:26.442364 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.442276    2575 generic.go:356] "Generic (PLEG): container finished" podID="e103d74a-2f92-45ed-abc8-46a87439a42f" containerID="161c7bccfcca545095c4707596cc13575252d11f647866d4f19e8deffe0895eb" exitCode=0
Jul 23 15:09:26.442364 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.442339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98" event={"ID":"e103d74a-2f92-45ed-abc8-46a87439a42f","Type":"ContainerDied","Data":"161c7bccfcca545095c4707596cc13575252d11f647866d4f19e8deffe0895eb"}
Jul 23 15:09:26.442525 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.442443    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98" event={"ID":"e103d74a-2f92-45ed-abc8-46a87439a42f","Type":"ContainerDied","Data":"5a2819a9da5a650078f4f05b45a802c26009270003f0c45326c95ccac826544c"}
Jul 23 15:09:26.442525 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.442496    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a2819a9da5a650078f4f05b45a802c26009270003f0c45326c95ccac826544c"
Jul 23 15:09:26.443554 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.443536    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:26.481138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.481106    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e103d74a-2f92-45ed-abc8-46a87439a42f-extensions-socket-volume\") pod \"e103d74a-2f92-45ed-abc8-46a87439a42f\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") "
Jul 23 15:09:26.481325 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.481202    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ssh5\" (UniqueName: \"kubernetes.io/projected/e103d74a-2f92-45ed-abc8-46a87439a42f-kube-api-access-5ssh5\") pod \"e103d74a-2f92-45ed-abc8-46a87439a42f\" (UID: \"e103d74a-2f92-45ed-abc8-46a87439a42f\") "
Jul 23 15:09:26.481592 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.481565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e103d74a-2f92-45ed-abc8-46a87439a42f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e103d74a-2f92-45ed-abc8-46a87439a42f" (UID: "e103d74a-2f92-45ed-abc8-46a87439a42f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:09:26.483410 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.483382    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e103d74a-2f92-45ed-abc8-46a87439a42f-kube-api-access-5ssh5" (OuterVolumeSpecName: "kube-api-access-5ssh5") pod "e103d74a-2f92-45ed-abc8-46a87439a42f" (UID: "e103d74a-2f92-45ed-abc8-46a87439a42f"). InnerVolumeSpecName "kube-api-access-5ssh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:09:26.582158 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.582119    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e103d74a-2f92-45ed-abc8-46a87439a42f-extensions-socket-volume\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:26.582158 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:26.582151    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ssh5\" (UniqueName: \"kubernetes.io/projected/e103d74a-2f92-45ed-abc8-46a87439a42f-kube-api-access-5ssh5\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:09:27.447301 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:27.447271    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"
Jul 23 15:09:27.486500 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:27.486464    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"]
Jul 23 15:09:27.498077 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:27.498047    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-crp98"]
Jul 23 15:09:27.865854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:27.865777    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e103d74a-2f92-45ed-abc8-46a87439a42f" path="/var/lib/kubelet/pods/e103d74a-2f92-45ed-abc8-46a87439a42f/volumes"
Jul 23 15:09:42.815816 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:42.815781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:09:42.960360 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:09:42.960322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:03.935335 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.935298    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fltqx"]
Jul 23 15:10:03.935797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.935655    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" containerName="manager"
Jul 23 15:10:03.935797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.935667    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" containerName="manager"
Jul 23 15:10:03.935797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.935685    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e103d74a-2f92-45ed-abc8-46a87439a42f" containerName="manager"
Jul 23 15:10:03.935797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.935690    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e103d74a-2f92-45ed-abc8-46a87439a42f" containerName="manager"
Jul 23 15:10:03.935797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.935757    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e103d74a-2f92-45ed-abc8-46a87439a42f" containerName="manager"
Jul 23 15:10:03.935797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.935768    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="456d520e-43d3-4385-9356-3a2b9ab71ce1" containerName="manager"
Jul 23 15:10:03.938852 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.938834    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:03.943897 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.943873    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 15:10:03.944027 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.943912    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k7lbl\""
Jul 23 15:10:03.966978 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.966943    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fltqx"]
Jul 23 15:10:03.975311 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:03.975282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:04.019692 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.019660    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fltqx"]
Jul 23 15:10:04.118268 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.118236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwt5s\" (UniqueName: \"kubernetes.io/projected/c311a974-ad8f-4d37-a2df-ff3613271af7-kube-api-access-zwt5s\") pod \"limitador-limitador-64c94fd64f-fltqx\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:04.118446 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.118339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c311a974-ad8f-4d37-a2df-ff3613271af7-config-file\") pod \"limitador-limitador-64c94fd64f-fltqx\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:04.219027 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.218928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwt5s\" (UniqueName: \"kubernetes.io/projected/c311a974-ad8f-4d37-a2df-ff3613271af7-kube-api-access-zwt5s\") pod \"limitador-limitador-64c94fd64f-fltqx\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:04.219027 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.218995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c311a974-ad8f-4d37-a2df-ff3613271af7-config-file\") pod \"limitador-limitador-64c94fd64f-fltqx\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:04.219616 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.219595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c311a974-ad8f-4d37-a2df-ff3613271af7-config-file\") pod \"limitador-limitador-64c94fd64f-fltqx\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:04.233023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.232992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwt5s\" (UniqueName: \"kubernetes.io/projected/c311a974-ad8f-4d37-a2df-ff3613271af7-kube-api-access-zwt5s\") pod \"limitador-limitador-64c94fd64f-fltqx\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:04.249906 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.249879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:04.394235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.394198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fltqx"]
Jul 23 15:10:04.398475 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:10:04.398450    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc311a974_ad8f_4d37_a2df_ff3613271af7.slice/crio-6885d49ca53521bd0a141da44732d37186f0c061c095c41d9501fd24709a47b0 WatchSource:0}: Error finding container 6885d49ca53521bd0a141da44732d37186f0c061c095c41d9501fd24709a47b0: Status 404 returned error can't find the container with id 6885d49ca53521bd0a141da44732d37186f0c061c095c41d9501fd24709a47b0
Jul 23 15:10:04.514823 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.514735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:04.616959 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.616917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:04.621763 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.621738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx" event={"ID":"c311a974-ad8f-4d37-a2df-ff3613271af7","Type":"ContainerStarted","Data":"6885d49ca53521bd0a141da44732d37186f0c061c095c41d9501fd24709a47b0"}
Jul 23 15:10:04.840397 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.840313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:04.951364 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:04.951331    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:08.643069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:08.643032    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx" event={"ID":"c311a974-ad8f-4d37-a2df-ff3613271af7","Type":"ContainerStarted","Data":"e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c"}
Jul 23 15:10:08.643563 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:08.643141    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:08.663890 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:08.663836    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx" podStartSLOduration=2.3640642610000002 podStartE2EDuration="5.663819376s" totalImagesPullingTime="3.299755115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:10:08.662057601 +0000 UTC m=+593.375989538" watchObservedRunningTime="2026-07-23 15:10:08.663819376 +0000 UTC m=+593.377751312"
Jul 23 15:10:13.442164 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:13.442125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:13.536039 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:13.536008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:19.649027 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:19.648992    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:22.425811 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:22.425768    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fltqx"]
Jul 23 15:10:22.426379 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:22.426003    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx" podUID="c311a974-ad8f-4d37-a2df-ff3613271af7" containerName="limitador" containerID="cri-o://e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c" gracePeriod=30
Jul 23 15:10:22.982920 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:22.982853    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:23.092304 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.092263    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c311a974-ad8f-4d37-a2df-ff3613271af7-config-file\") pod \"c311a974-ad8f-4d37-a2df-ff3613271af7\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") "
Jul 23 15:10:23.092483 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.092359    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwt5s\" (UniqueName: \"kubernetes.io/projected/c311a974-ad8f-4d37-a2df-ff3613271af7-kube-api-access-zwt5s\") pod \"c311a974-ad8f-4d37-a2df-ff3613271af7\" (UID: \"c311a974-ad8f-4d37-a2df-ff3613271af7\") "
Jul 23 15:10:23.092642 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.092619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c311a974-ad8f-4d37-a2df-ff3613271af7-config-file" (OuterVolumeSpecName: "config-file") pod "c311a974-ad8f-4d37-a2df-ff3613271af7" (UID: "c311a974-ad8f-4d37-a2df-ff3613271af7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:10:23.094431 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.094401    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c311a974-ad8f-4d37-a2df-ff3613271af7-kube-api-access-zwt5s" (OuterVolumeSpecName: "kube-api-access-zwt5s") pod "c311a974-ad8f-4d37-a2df-ff3613271af7" (UID: "c311a974-ad8f-4d37-a2df-ff3613271af7"). InnerVolumeSpecName "kube-api-access-zwt5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:10:23.193126 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.193096    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c311a974-ad8f-4d37-a2df-ff3613271af7-config-file\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:10:23.193126 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.193121    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwt5s\" (UniqueName: \"kubernetes.io/projected/c311a974-ad8f-4d37-a2df-ff3613271af7-kube-api-access-zwt5s\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:10:23.712549 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.712512    2575 generic.go:356] "Generic (PLEG): container finished" podID="c311a974-ad8f-4d37-a2df-ff3613271af7" containerID="e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c" exitCode=0
Jul 23 15:10:23.713082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.712567    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx"
Jul 23 15:10:23.713082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.712596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx" event={"ID":"c311a974-ad8f-4d37-a2df-ff3613271af7","Type":"ContainerDied","Data":"e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c"}
Jul 23 15:10:23.713082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.712692    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fltqx" event={"ID":"c311a974-ad8f-4d37-a2df-ff3613271af7","Type":"ContainerDied","Data":"6885d49ca53521bd0a141da44732d37186f0c061c095c41d9501fd24709a47b0"}
Jul 23 15:10:23.713082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.712726    2575 scope.go:117] "RemoveContainer" containerID="e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c"
Jul 23 15:10:23.721864 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.721848    2575 scope.go:117] "RemoveContainer" containerID="e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c"
Jul 23 15:10:23.722089 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:10:23.722070    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c\": container with ID starting with e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c not found: ID does not exist" containerID="e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c"
Jul 23 15:10:23.722151 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.722095    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c"} err="failed to get container status \"e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c\": rpc error: code = NotFound desc = could not find container \"e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c\": container with ID starting with e9706c775468523cf3d9b8c3d23bedf66b7bf5a867c8baabd1021faa0a8eb80c not found: ID does not exist"
Jul 23 15:10:23.736673 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.736645    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fltqx"]
Jul 23 15:10:23.740618 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.740597    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fltqx"]
Jul 23 15:10:23.865860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:23.865831    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c311a974-ad8f-4d37-a2df-ff3613271af7" path="/var/lib/kubelet/pods/c311a974-ad8f-4d37-a2df-ff3613271af7/volumes"
Jul 23 15:10:27.239965 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.239935    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:27.339425 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.339391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:27.716554 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.716521    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"]
Jul 23 15:10:27.716968 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.716952    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c311a974-ad8f-4d37-a2df-ff3613271af7" containerName="limitador"
Jul 23 15:10:27.717044 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.716969    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c311a974-ad8f-4d37-a2df-ff3613271af7" containerName="limitador"
Jul 23 15:10:27.717105 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.717088    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c311a974-ad8f-4d37-a2df-ff3613271af7" containerName="limitador"
Jul 23 15:10:27.721763 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.721742    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:27.724747 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.724727    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 15:10:27.724877 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.724729    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:10:27.725779 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.725761    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5p27s\""
Jul 23 15:10:27.725855 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.725771    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 15:10:27.731001 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.730973    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"]
Jul 23 15:10:27.751762 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.751722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:27.833486 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.833455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed034-8cac-47f4-b28e-3ed07aff312d-data\") pod \"postgres-69fb4594cf-xx4gs\" (UID: \"5a2ed034-8cac-47f4-b28e-3ed07aff312d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:27.833647 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.833513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ms6l\" (UniqueName: \"kubernetes.io/projected/5a2ed034-8cac-47f4-b28e-3ed07aff312d-kube-api-access-5ms6l\") pod \"postgres-69fb4594cf-xx4gs\" (UID: \"5a2ed034-8cac-47f4-b28e-3ed07aff312d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:27.934154 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.934118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed034-8cac-47f4-b28e-3ed07aff312d-data\") pod \"postgres-69fb4594cf-xx4gs\" (UID: \"5a2ed034-8cac-47f4-b28e-3ed07aff312d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:27.934379 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.934221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ms6l\" (UniqueName: \"kubernetes.io/projected/5a2ed034-8cac-47f4-b28e-3ed07aff312d-kube-api-access-5ms6l\") pod \"postgres-69fb4594cf-xx4gs\" (UID: \"5a2ed034-8cac-47f4-b28e-3ed07aff312d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:27.934616 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.934583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a2ed034-8cac-47f4-b28e-3ed07aff312d-data\") pod \"postgres-69fb4594cf-xx4gs\" (UID: \"5a2ed034-8cac-47f4-b28e-3ed07aff312d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:27.944549 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:27.944516    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ms6l\" (UniqueName: \"kubernetes.io/projected/5a2ed034-8cac-47f4-b28e-3ed07aff312d-kube-api-access-5ms6l\") pod \"postgres-69fb4594cf-xx4gs\" (UID: \"5a2ed034-8cac-47f4-b28e-3ed07aff312d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:28.033251 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:28.033126    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:28.171023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:28.170905    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"]
Jul 23 15:10:28.175812 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:10:28.175783    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2ed034_8cac_47f4_b28e_3ed07aff312d.slice/crio-a8a1e8d155cde6f7e9d7d6c4c135dff058d3830c446e8ecc5b4e8008386fb993 WatchSource:0}: Error finding container a8a1e8d155cde6f7e9d7d6c4c135dff058d3830c446e8ecc5b4e8008386fb993: Status 404 returned error can't find the container with id a8a1e8d155cde6f7e9d7d6c4c135dff058d3830c446e8ecc5b4e8008386fb993
Jul 23 15:10:28.742612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:28.742574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs" event={"ID":"5a2ed034-8cac-47f4-b28e-3ed07aff312d","Type":"ContainerStarted","Data":"a8a1e8d155cde6f7e9d7d6c4c135dff058d3830c446e8ecc5b4e8008386fb993"}
Jul 23 15:10:30.623921 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:30.623880    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:31.920974 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:31.920938    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:32.022811 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:32.022776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:33.772646 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:33.772610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs" event={"ID":"5a2ed034-8cac-47f4-b28e-3ed07aff312d","Type":"ContainerStarted","Data":"568620abbf5eacda5e26998e14418d16e9da5fe8a609539cc89ba8af48401135"}
Jul 23 15:10:33.773057 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:33.772743    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:33.795239 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:33.795161    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs" podStartSLOduration=1.86597243 podStartE2EDuration="6.795143256s" totalImagesPullingTime="4.929170826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:10:33.792699158 +0000 UTC m=+618.506631096" watchObservedRunningTime="2026-07-23 15:10:33.795143256 +0000 UTC m=+618.509075193"
Jul 23 15:10:39.808591 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:39.808556    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx4gs"
Jul 23 15:10:40.158949 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:40.158874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:40.349225 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:40.349185    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:47.435241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.435210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:47.442841 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.442808    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fb89847fc-sp2tx"]
Jul 23 15:10:47.445305 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.445286    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.448887 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.448845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 15:10:47.449055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.448928    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 15:10:47.449117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.449080    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c89l2\""
Jul 23 15:10:47.471556 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.471521    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fb89847fc-sp2tx"]
Jul 23 15:10:47.613810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.613772    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cd768775d-jwbtp"]
Jul 23 15:10:47.616118 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.616100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:47.623381 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.623355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e90220b5-e30d-4dad-834a-a79d2cf6151e-webhook-cert\") pod \"maas-controller-6fb89847fc-sp2tx\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") " pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.623505 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.623422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkm2h\" (UniqueName: \"kubernetes.io/projected/e90220b5-e30d-4dad-834a-a79d2cf6151e-kube-api-access-nkm2h\") pod \"maas-controller-6fb89847fc-sp2tx\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") " pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.628031 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.628004    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd768775d-jwbtp"]
Jul 23 15:10:47.724059 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.723964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvhg7\" (UniqueName: \"kubernetes.io/projected/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-kube-api-access-qvhg7\") pod \"maas-controller-6cd768775d-jwbtp\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") " pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:47.724235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.724070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e90220b5-e30d-4dad-834a-a79d2cf6151e-webhook-cert\") pod \"maas-controller-6fb89847fc-sp2tx\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") " pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.724235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.724110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-webhook-cert\") pod \"maas-controller-6cd768775d-jwbtp\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") " pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:47.724235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.724158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkm2h\" (UniqueName: \"kubernetes.io/projected/e90220b5-e30d-4dad-834a-a79d2cf6151e-kube-api-access-nkm2h\") pod \"maas-controller-6fb89847fc-sp2tx\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") " pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.726461 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.726442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e90220b5-e30d-4dad-834a-a79d2cf6151e-webhook-cert\") pod \"maas-controller-6fb89847fc-sp2tx\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") " pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.733893 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.733856    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkm2h\" (UniqueName: \"kubernetes.io/projected/e90220b5-e30d-4dad-834a-a79d2cf6151e-kube-api-access-nkm2h\") pod \"maas-controller-6fb89847fc-sp2tx\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") " pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.755667 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.755624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:47.824969 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.824936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-webhook-cert\") pod \"maas-controller-6cd768775d-jwbtp\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") " pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:47.825157 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.825004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvhg7\" (UniqueName: \"kubernetes.io/projected/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-kube-api-access-qvhg7\") pod \"maas-controller-6cd768775d-jwbtp\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") " pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:47.827360 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.827336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-webhook-cert\") pod \"maas-controller-6cd768775d-jwbtp\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") " pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:47.834932 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.834900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvhg7\" (UniqueName: \"kubernetes.io/projected/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-kube-api-access-qvhg7\") pod \"maas-controller-6cd768775d-jwbtp\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") " pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:47.901862 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.901829    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fb89847fc-sp2tx"]
Jul 23 15:10:47.904735 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:10:47.904707    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90220b5_e30d_4dad_834a_a79d2cf6151e.slice/crio-8ca6d1ef9d7409559639041ff2425d1d1c99de1800c325de616833530c1560bc WatchSource:0}: Error finding container 8ca6d1ef9d7409559639041ff2425d1d1c99de1800c325de616833530c1560bc: Status 404 returned error can't find the container with id 8ca6d1ef9d7409559639041ff2425d1d1c99de1800c325de616833530c1560bc
Jul 23 15:10:47.926647 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:47.926612    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:48.063687 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:48.063665    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd768775d-jwbtp"]
Jul 23 15:10:48.065656 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:10:48.065630    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8fc4c7e_d62e_4e8c_b223_8d2b783eb5b9.slice/crio-dd8d2ec999b58f3501d6cd74e76455a76e65833cda3dba1e197dfe041c394d4f WatchSource:0}: Error finding container dd8d2ec999b58f3501d6cd74e76455a76e65833cda3dba1e197dfe041c394d4f: Status 404 returned error can't find the container with id dd8d2ec999b58f3501d6cd74e76455a76e65833cda3dba1e197dfe041c394d4f
Jul 23 15:10:48.848402 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:48.848362    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb89847fc-sp2tx" event={"ID":"e90220b5-e30d-4dad-834a-a79d2cf6151e","Type":"ContainerStarted","Data":"8ca6d1ef9d7409559639041ff2425d1d1c99de1800c325de616833530c1560bc"}
Jul 23 15:10:48.850207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:48.850112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-jwbtp" event={"ID":"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9","Type":"ContainerStarted","Data":"dd8d2ec999b58f3501d6cd74e76455a76e65833cda3dba1e197dfe041c394d4f"}
Jul 23 15:10:49.287866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:49.287821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:50.559359 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:50.559318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:50.661327 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:50.661293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:10:50.863781 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:50.863711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-jwbtp" event={"ID":"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9","Type":"ContainerStarted","Data":"8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287"}
Jul 23 15:10:50.863971 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:50.863806    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:10:50.865251 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:50.865226    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb89847fc-sp2tx" event={"ID":"e90220b5-e30d-4dad-834a-a79d2cf6151e","Type":"ContainerStarted","Data":"8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3"}
Jul 23 15:10:50.865354 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:50.865275    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:10:50.943187 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:50.943063    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cd768775d-jwbtp" podStartSLOduration=1.656178698 podStartE2EDuration="3.94304498s" totalImagesPullingTime="2.286866282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:10:50.941302257 +0000 UTC m=+635.655234195" watchObservedRunningTime="2026-07-23 15:10:50.94304498 +0000 UTC m=+635.656976895"
Jul 23 15:10:51.069221 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:10:51.069147    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fb89847fc-sp2tx" podStartSLOduration=1.629285522 podStartE2EDuration="4.069130968s" totalImagesPullingTime="2.439845446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:10:51.067890666 +0000 UTC m=+635.781822602" watchObservedRunningTime="2026-07-23 15:10:51.069130968 +0000 UTC m=+635.783062904"
Jul 23 15:11:01.872746 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:01.872711    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:11:01.873355 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:01.872930    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:11:01.998807 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:01.998769    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fb89847fc-sp2tx"]
Jul 23 15:11:01.999045 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:01.998997    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6fb89847fc-sp2tx" podUID="e90220b5-e30d-4dad-834a-a79d2cf6151e" containerName="manager" containerID="cri-o://8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3" gracePeriod=30
Jul 23 15:11:02.259025 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.258991    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:11:02.364479 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.364444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkm2h\" (UniqueName: \"kubernetes.io/projected/e90220b5-e30d-4dad-834a-a79d2cf6151e-kube-api-access-nkm2h\") pod \"e90220b5-e30d-4dad-834a-a79d2cf6151e\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") "
Jul 23 15:11:02.364674 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.364537    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e90220b5-e30d-4dad-834a-a79d2cf6151e-webhook-cert\") pod \"e90220b5-e30d-4dad-834a-a79d2cf6151e\" (UID: \"e90220b5-e30d-4dad-834a-a79d2cf6151e\") "
Jul 23 15:11:02.366622 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.366585    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90220b5-e30d-4dad-834a-a79d2cf6151e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e90220b5-e30d-4dad-834a-a79d2cf6151e" (UID: "e90220b5-e30d-4dad-834a-a79d2cf6151e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:11:02.366731 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.366619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90220b5-e30d-4dad-834a-a79d2cf6151e-kube-api-access-nkm2h" (OuterVolumeSpecName: "kube-api-access-nkm2h") pod "e90220b5-e30d-4dad-834a-a79d2cf6151e" (UID: "e90220b5-e30d-4dad-834a-a79d2cf6151e"). InnerVolumeSpecName "kube-api-access-nkm2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:11:02.465725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.465631    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkm2h\" (UniqueName: \"kubernetes.io/projected/e90220b5-e30d-4dad-834a-a79d2cf6151e-kube-api-access-nkm2h\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:11:02.465725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.465665    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e90220b5-e30d-4dad-834a-a79d2cf6151e-webhook-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:11:02.925774 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.925741    2575 generic.go:356] "Generic (PLEG): container finished" podID="e90220b5-e30d-4dad-834a-a79d2cf6151e" containerID="8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3" exitCode=0
Jul 23 15:11:02.926238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.925789    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb89847fc-sp2tx"
Jul 23 15:11:02.926238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.925815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb89847fc-sp2tx" event={"ID":"e90220b5-e30d-4dad-834a-a79d2cf6151e","Type":"ContainerDied","Data":"8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3"}
Jul 23 15:11:02.926238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.925855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb89847fc-sp2tx" event={"ID":"e90220b5-e30d-4dad-834a-a79d2cf6151e","Type":"ContainerDied","Data":"8ca6d1ef9d7409559639041ff2425d1d1c99de1800c325de616833530c1560bc"}
Jul 23 15:11:02.926238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.925878    2575 scope.go:117] "RemoveContainer" containerID="8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3"
Jul 23 15:11:02.935184 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.935146    2575 scope.go:117] "RemoveContainer" containerID="8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3"
Jul 23 15:11:02.935508 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:11:02.935488    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3\": container with ID starting with 8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3 not found: ID does not exist" containerID="8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3"
Jul 23 15:11:02.935558 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.935517    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3"} err="failed to get container status \"8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3\": rpc error: code = NotFound desc = could not find container \"8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3\": container with ID starting with 8ab84333999dc0fcd2e8b7f581bbfdad0148128393acc38c6e1fd4c6f66c1eb3 not found: ID does not exist"
Jul 23 15:11:02.957645 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.957609    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fb89847fc-sp2tx"]
Jul 23 15:11:02.966074 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:02.966043    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fb89847fc-sp2tx"]
Jul 23 15:11:03.865654 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:03.865617    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e90220b5-e30d-4dad-834a-a79d2cf6151e" path="/var/lib/kubelet/pods/e90220b5-e30d-4dad-834a-a79d2cf6151e/volumes"
Jul 23 15:11:23.469177 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:23.469132    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:23.560893 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:23.560850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:24.174150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.174120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:24.253638 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.253600    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"]
Jul 23 15:11:24.254059 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.254040    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90220b5-e30d-4dad-834a-a79d2cf6151e" containerName="manager"
Jul 23 15:11:24.254155 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.254062    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90220b5-e30d-4dad-834a-a79d2cf6151e" containerName="manager"
Jul 23 15:11:24.254262 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.254158    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90220b5-e30d-4dad-834a-a79d2cf6151e" containerName="manager"
Jul 23 15:11:24.262242 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.262216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.265935 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.265911    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hzktn\""
Jul 23 15:11:24.266064 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.266044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 15:11:24.280844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.280814    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"]
Jul 23 15:11:24.368986 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.368952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db78ff21-3dcf-403d-a2fe-6e6818186048-maas-api-tls\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.369209 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.369001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db78ff21-3dcf-403d-a2fe-6e6818186048-openshift-service-ca\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.369209 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.369064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznfv\" (UniqueName: \"kubernetes.io/projected/db78ff21-3dcf-403d-a2fe-6e6818186048-kube-api-access-rznfv\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.467968 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.467877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:24.470116 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.470085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db78ff21-3dcf-403d-a2fe-6e6818186048-openshift-service-ca\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.470511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.470124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznfv\" (UniqueName: \"kubernetes.io/projected/db78ff21-3dcf-403d-a2fe-6e6818186048-kube-api-access-rznfv\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.470511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.470273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db78ff21-3dcf-403d-a2fe-6e6818186048-maas-api-tls\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.470827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.470806    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db78ff21-3dcf-403d-a2fe-6e6818186048-openshift-service-ca\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.472681 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.472658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db78ff21-3dcf-403d-a2fe-6e6818186048-maas-api-tls\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.481753 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.481725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznfv\" (UniqueName: \"kubernetes.io/projected/db78ff21-3dcf-403d-a2fe-6e6818186048-kube-api-access-rznfv\") pod \"maas-api-769cff4c48-ws4zz\" (UID: \"db78ff21-3dcf-403d-a2fe-6e6818186048\") " pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.572828 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.572787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:24.703783 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.703749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:24.727650 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.727623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"]
Jul 23 15:11:24.729803 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:11:24.729736    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb78ff21_3dcf_403d_a2fe_6e6818186048.slice/crio-21409512a998cd8ce713314b78bb3561d2185cb3a465ea50dc98e5de8525f6ed WatchSource:0}: Error finding container 21409512a998cd8ce713314b78bb3561d2185cb3a465ea50dc98e5de8525f6ed: Status 404 returned error can't find the container with id 21409512a998cd8ce713314b78bb3561d2185cb3a465ea50dc98e5de8525f6ed
Jul 23 15:11:24.731465 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.731434    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:11:24.825373 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.825342    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"]
Jul 23 15:11:24.830558 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.830533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:24.832695 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.832671    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-g2vvq"]
Jul 23 15:11:24.834375 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.834355    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 15:11:24.836444 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.836425    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:24.840616 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.839555    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g7fhw\""
Jul 23 15:11:24.841798 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.841772    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"]
Jul 23 15:11:24.850090 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.850067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-g2vvq"]
Jul 23 15:11:24.921296 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.921258    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:24.974681 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.974637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0c2366-2407-4bce-8075-7a683d90ce4e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-g2vvq\" (UID: \"0f0c2366-2407-4bce-8075-7a683d90ce4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:24.974841 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.974696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4fhz\" (UniqueName: \"kubernetes.io/projected/0f0c2366-2407-4bce-8075-7a683d90ce4e-kube-api-access-d4fhz\") pod \"payload-processing-5bf47cd988-g2vvq\" (UID: \"0f0c2366-2407-4bce-8075-7a683d90ce4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:24.974841 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.974753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66e2fc7b-d37f-46f4-a95d-a0021af8b571-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fnn6t\" (UID: \"66e2fc7b-d37f-46f4-a95d-a0021af8b571\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:24.974841 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:24.974799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjnx\" (UniqueName: \"kubernetes.io/projected/66e2fc7b-d37f-46f4-a95d-a0021af8b571-kube-api-access-ffjnx\") pod \"payload-pre-processing-7677b774bb-fnn6t\" (UID: \"66e2fc7b-d37f-46f4-a95d-a0021af8b571\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:25.035303 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.035207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz" event={"ID":"db78ff21-3dcf-403d-a2fe-6e6818186048","Type":"ContainerStarted","Data":"21409512a998cd8ce713314b78bb3561d2185cb3a465ea50dc98e5de8525f6ed"}
Jul 23 15:11:25.076267 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.076231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0c2366-2407-4bce-8075-7a683d90ce4e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-g2vvq\" (UID: \"0f0c2366-2407-4bce-8075-7a683d90ce4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:25.076267 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.076270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4fhz\" (UniqueName: \"kubernetes.io/projected/0f0c2366-2407-4bce-8075-7a683d90ce4e-kube-api-access-d4fhz\") pod \"payload-processing-5bf47cd988-g2vvq\" (UID: \"0f0c2366-2407-4bce-8075-7a683d90ce4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:25.076487 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.076301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66e2fc7b-d37f-46f4-a95d-a0021af8b571-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fnn6t\" (UID: \"66e2fc7b-d37f-46f4-a95d-a0021af8b571\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:25.076487 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.076328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjnx\" (UniqueName: \"kubernetes.io/projected/66e2fc7b-d37f-46f4-a95d-a0021af8b571-kube-api-access-ffjnx\") pod \"payload-pre-processing-7677b774bb-fnn6t\" (UID: \"66e2fc7b-d37f-46f4-a95d-a0021af8b571\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:25.077214 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.077163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f0c2366-2407-4bce-8075-7a683d90ce4e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-g2vvq\" (UID: \"0f0c2366-2407-4bce-8075-7a683d90ce4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:25.077266 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.077163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66e2fc7b-d37f-46f4-a95d-a0021af8b571-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fnn6t\" (UID: \"66e2fc7b-d37f-46f4-a95d-a0021af8b571\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:25.088235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.088200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjnx\" (UniqueName: \"kubernetes.io/projected/66e2fc7b-d37f-46f4-a95d-a0021af8b571-kube-api-access-ffjnx\") pod \"payload-pre-processing-7677b774bb-fnn6t\" (UID: \"66e2fc7b-d37f-46f4-a95d-a0021af8b571\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:25.088372 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.088282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4fhz\" (UniqueName: \"kubernetes.io/projected/0f0c2366-2407-4bce-8075-7a683d90ce4e-kube-api-access-d4fhz\") pod \"payload-processing-5bf47cd988-g2vvq\" (UID: \"0f0c2366-2407-4bce-8075-7a683d90ce4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:25.145013 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.144973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:25.154552 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.154524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:25.300079 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.299912    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"]
Jul 23 15:11:25.302419 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:11:25.302370    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e2fc7b_d37f_46f4_a95d_a0021af8b571.slice/crio-5adbb13256c1fd0d3206816345d566ad9c0fce2dd9e101b4ce4e23bdea2aa18c WatchSource:0}: Error finding container 5adbb13256c1fd0d3206816345d566ad9c0fce2dd9e101b4ce4e23bdea2aa18c: Status 404 returned error can't find the container with id 5adbb13256c1fd0d3206816345d566ad9c0fce2dd9e101b4ce4e23bdea2aa18c
Jul 23 15:11:25.322498 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:25.322473    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-g2vvq"]
Jul 23 15:11:25.325790 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:11:25.325763    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0c2366_2407_4bce_8075_7a683d90ce4e.slice/crio-3783d2a6a2cccda2146dfa2503b10fc14c8973fb467c33eb46a67b8dcefad4b9 WatchSource:0}: Error finding container 3783d2a6a2cccda2146dfa2503b10fc14c8973fb467c33eb46a67b8dcefad4b9: Status 404 returned error can't find the container with id 3783d2a6a2cccda2146dfa2503b10fc14c8973fb467c33eb46a67b8dcefad4b9
Jul 23 15:11:26.045054 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:26.044973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq" event={"ID":"0f0c2366-2407-4bce-8075-7a683d90ce4e","Type":"ContainerStarted","Data":"3783d2a6a2cccda2146dfa2503b10fc14c8973fb467c33eb46a67b8dcefad4b9"}
Jul 23 15:11:26.046853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:26.046761    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t" event={"ID":"66e2fc7b-d37f-46f4-a95d-a0021af8b571","Type":"ContainerStarted","Data":"5adbb13256c1fd0d3206816345d566ad9c0fce2dd9e101b4ce4e23bdea2aa18c"}
Jul 23 15:11:27.055510 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:27.055408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz" event={"ID":"db78ff21-3dcf-403d-a2fe-6e6818186048","Type":"ContainerStarted","Data":"c82d417538ac28817884b94d88b691ae6735ce5d5a8f541d204b2b07c275ed8e"}
Jul 23 15:11:27.056030 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:27.055638    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:27.092665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:27.092589    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz" podStartSLOduration=1.045661487 podStartE2EDuration="3.092565493s" totalImagesPullingTime="2.046904006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:11:27.091348068 +0000 UTC m=+671.805280031" watchObservedRunningTime="2026-07-23 15:11:27.092565493 +0000 UTC m=+671.806497431"
Jul 23 15:11:28.062004 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:28.061965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq" event={"ID":"0f0c2366-2407-4bce-8075-7a683d90ce4e","Type":"ContainerStarted","Data":"5b4989c58dee3049ac00406e5a9249b9b3a79cd128842e8cff67ca633590f311"}
Jul 23 15:11:28.062539 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:28.062073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:28.063782 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:28.063757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t" event={"ID":"66e2fc7b-d37f-46f4-a95d-a0021af8b571","Type":"ContainerStarted","Data":"b76711a2fbc2c3014a8495f93b94fccd3574a03fb3df12dfbce56722cca93b40"}
Jul 23 15:11:28.063922 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:28.063870    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:28.088781 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:28.088727    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq" podStartSLOduration=2.086191307 podStartE2EDuration="4.088708881s" totalImagesPullingTime="2.002517574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:11:28.086142916 +0000 UTC m=+672.800074874" watchObservedRunningTime="2026-07-23 15:11:28.088708881 +0000 UTC m=+672.802640818"
Jul 23 15:11:28.114570 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:28.114503    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t" podStartSLOduration=2.077620525 podStartE2EDuration="4.114484504s" totalImagesPullingTime="2.036863979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:11:28.112407957 +0000 UTC m=+672.826339893" watchObservedRunningTime="2026-07-23 15:11:28.114484504 +0000 UTC m=+672.828416441"
Jul 23 15:11:33.069811 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:33.069781    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-769cff4c48-ws4zz"
Jul 23 15:11:34.313048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:34.313011    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:34.437545 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:34.437513    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:39.070854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.070822    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-g2vvq"
Jul 23 15:11:39.071291 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.070897    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fnn6t"
Jul 23 15:11:39.211034 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.211000    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"]
Jul 23 15:11:39.215791 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.215773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.241783 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.241739    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 15:11:39.242122 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.242105    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2jgt\""
Jul 23 15:11:39.242245 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.242126    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 15:11:39.242380 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.242365    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 15:11:39.249959 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.249929    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"]
Jul 23 15:11:39.267032 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.267004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:39.311117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.311085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.311348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.311250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.311348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.311286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3547f129-5835-4c0a-986c-dbb7d1de54ae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.311490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.311442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.311490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.311479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.311595 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.311520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgmm9\" (UniqueName: \"kubernetes.io/projected/3547f129-5835-4c0a-986c-dbb7d1de54ae-kube-api-access-wgmm9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.412670 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.412631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.412866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.412713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.412866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.412731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3547f129-5835-4c0a-986c-dbb7d1de54ae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.412866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.412763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.412866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.412779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.412866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.412824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgmm9\" (UniqueName: \"kubernetes.io/projected/3547f129-5835-4c0a-986c-dbb7d1de54ae-kube-api-access-wgmm9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.413227 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.413203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.413291 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.413267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.413335 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.413295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.415010 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.414983    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3547f129-5835-4c0a-986c-dbb7d1de54ae-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.415267 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.415251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3547f129-5835-4c0a-986c-dbb7d1de54ae-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.425727 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.425700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgmm9\" (UniqueName: \"kubernetes.io/projected/3547f129-5835-4c0a-986c-dbb7d1de54ae-kube-api-access-wgmm9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4\" (UID: \"3547f129-5835-4c0a-986c-dbb7d1de54ae\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.527084 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.527045    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:39.681708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:39.681679    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"]
Jul 23 15:11:39.683889 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:11:39.683861    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3547f129_5835_4c0a_986c_dbb7d1de54ae.slice/crio-775ce3f79ea21b6bdd68ce3a47dec25fb38a5d23b1339c0dba69db287f079c6a WatchSource:0}: Error finding container 775ce3f79ea21b6bdd68ce3a47dec25fb38a5d23b1339c0dba69db287f079c6a: Status 404 returned error can't find the container with id 775ce3f79ea21b6bdd68ce3a47dec25fb38a5d23b1339c0dba69db287f079c6a
Jul 23 15:11:40.126208 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:40.126055    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4" event={"ID":"3547f129-5835-4c0a-986c-dbb7d1de54ae","Type":"ContainerStarted","Data":"775ce3f79ea21b6bdd68ce3a47dec25fb38a5d23b1339c0dba69db287f079c6a"}
Jul 23 15:11:41.133676 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:41.133572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4" event={"ID":"3547f129-5835-4c0a-986c-dbb7d1de54ae","Type":"ContainerStarted","Data":"3b76ed6b318bf80f1b88d540129f53802234f2011f44c59debc360746cb639ef"}
Jul 23 15:11:45.177394 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:45.177358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:45.274385 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:45.274349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:47.465986 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:47.465951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:11:49.527408 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:49.527369    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:49.527834 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:49.527465    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:49.540214 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:49.540157    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:11:49.565140 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:49.565086    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4" podStartSLOduration=9.428739425 podStartE2EDuration="10.565070988s" totalImagesPullingTime="1.136331563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:11:41.175045579 +0000 UTC m=+685.888977517" watchObservedRunningTime="2026-07-23 15:11:49.565070988 +0000 UTC m=+694.279002977"
Jul 23 15:11:50.189187 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:11:50.189140    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4"
Jul 23 15:12:09.783033 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.782940    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"]
Jul 23 15:12:09.788158 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.788131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:09.801502 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.801476    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 15:12:09.820029 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.819995    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"]
Jul 23 15:12:09.885603 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.885570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:12:09.905255 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.905223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e77b26d-dc62-45b8-aca5-ee95a2875157-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:09.905450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.905267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:09.905450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.905358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:09.905450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.905406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppngc\" (UniqueName: \"kubernetes.io/projected/6e77b26d-dc62-45b8-aca5-ee95a2875157-kube-api-access-ppngc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:09.905589 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.905508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:09.905589 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:09.905542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.006620 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.006573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppngc\" (UniqueName: \"kubernetes.io/projected/6e77b26d-dc62-45b8-aca5-ee95a2875157-kube-api-access-ppngc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.006844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.006661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.006844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.006691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.006844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.006732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e77b26d-dc62-45b8-aca5-ee95a2875157-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.006844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.006759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.006844 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.006817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.007143 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.007092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.007237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.007165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.007303 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.007275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.009151 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.009126    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e77b26d-dc62-45b8-aca5-ee95a2875157-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.009343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.009325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e77b26d-dc62-45b8-aca5-ee95a2875157-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.016381 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.016350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppngc\" (UniqueName: \"kubernetes.io/projected/6e77b26d-dc62-45b8-aca5-ee95a2875157-kube-api-access-ppngc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4ffb\" (UID: \"6e77b26d-dc62-45b8-aca5-ee95a2875157\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.099424 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.099329    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:10.255226 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.255202    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"]
Jul 23 15:12:10.257897 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:12:10.257867    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e77b26d_dc62_45b8_aca5_ee95a2875157.slice/crio-f281ad8b395ba225d1d1aba5af49070f44d5cc0a973f1d1594dbf7888037025c WatchSource:0}: Error finding container f281ad8b395ba225d1d1aba5af49070f44d5cc0a973f1d1594dbf7888037025c: Status 404 returned error can't find the container with id f281ad8b395ba225d1d1aba5af49070f44d5cc0a973f1d1594dbf7888037025c
Jul 23 15:12:10.286735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:10.286704    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb" event={"ID":"6e77b26d-dc62-45b8-aca5-ee95a2875157","Type":"ContainerStarted","Data":"f281ad8b395ba225d1d1aba5af49070f44d5cc0a973f1d1594dbf7888037025c"}
Jul 23 15:12:11.293294 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:11.293255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb" event={"ID":"6e77b26d-dc62-45b8-aca5-ee95a2875157","Type":"ContainerStarted","Data":"db538f08d8e20e6e0e871f0a22837c26f608ad0acb2cd5782f01332da185c2a8"}
Jul 23 15:12:11.326482 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:11.326425    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb" podStartSLOduration=2.065605131 podStartE2EDuration="2.326408821s" totalImagesPullingTime="260.80369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:11.325737905 +0000 UTC m=+716.039669854" watchObservedRunningTime="2026-07-23 15:12:11.326408821 +0000 UTC m=+716.040340797"
Jul 23 15:12:20.099616 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:20.099558    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:20.100198 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:20.099640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:20.112223 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:20.112195    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:20.355781 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:20.355687    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4ffb"
Jul 23 15:12:24.666056 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:24.666021    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:12:46.198326 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:46.198293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:12:52.850641 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:52.850598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:12:57.685282 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:12:57.685242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:13:49.030425 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:13:49.030339    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:13:52.390315 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:13:52.390281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:13:52.460753 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:13:52.460722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:13:53.686468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:13:53.686434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:13:53.787189 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:13:53.787148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:14:43.385590 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.385552    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cd768775d-jwbtp"]
Jul 23 15:14:43.386211 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.385727    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cd768775d-jwbtp" podUID="c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" containerName="manager" containerID="cri-o://8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287" gracePeriod=30
Jul 23 15:14:43.638014 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.637949    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:14:43.782163 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.782128    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvhg7\" (UniqueName: \"kubernetes.io/projected/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-kube-api-access-qvhg7\") pod \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") "
Jul 23 15:14:43.782367 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.782240    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-webhook-cert\") pod \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\" (UID: \"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9\") "
Jul 23 15:14:43.784250 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.784216    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" (UID: "c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:14:43.784369 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.784227    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-kube-api-access-qvhg7" (OuterVolumeSpecName: "kube-api-access-qvhg7") pod "c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" (UID: "c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9"). InnerVolumeSpecName "kube-api-access-qvhg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:14:43.882912 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.882883    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvhg7\" (UniqueName: \"kubernetes.io/projected/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-kube-api-access-qvhg7\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:14:43.882912 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:43.882912    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9-webhook-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:14:44.068852 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.068816    2575 generic.go:356] "Generic (PLEG): container finished" podID="c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" containerID="8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287" exitCode=0
Jul 23 15:14:44.069036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.068862    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-jwbtp"
Jul 23 15:14:44.069036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.068903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-jwbtp" event={"ID":"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9","Type":"ContainerDied","Data":"8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287"}
Jul 23 15:14:44.069036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.068958    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-jwbtp" event={"ID":"c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9","Type":"ContainerDied","Data":"dd8d2ec999b58f3501d6cd74e76455a76e65833cda3dba1e197dfe041c394d4f"}
Jul 23 15:14:44.069036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.068980    2575 scope.go:117] "RemoveContainer" containerID="8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287"
Jul 23 15:14:44.077697 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.077678    2575 scope.go:117] "RemoveContainer" containerID="8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287"
Jul 23 15:14:44.077968 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:14:44.077945    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287\": container with ID starting with 8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287 not found: ID does not exist" containerID="8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287"
Jul 23 15:14:44.078052 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.077972    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287"} err="failed to get container status \"8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287\": rpc error: code = NotFound desc = could not find container \"8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287\": container with ID starting with 8923199ba5475420703386b2797a1d7fb76279a5636b34c1edeafacb1b5fc287 not found: ID does not exist"
Jul 23 15:14:44.096734 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.096693    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cd768775d-jwbtp"]
Jul 23 15:14:44.098649 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:44.098618    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cd768775d-jwbtp"]
Jul 23 15:14:45.866534 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:14:45.866493    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" path="/var/lib/kubelet/pods/c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9/volumes"
Jul 23 15:15:45.022593 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.022549    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cd768775d-9d9pw"]
Jul 23 15:15:45.023486 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.023455    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" containerName="manager"
Jul 23 15:15:45.023486 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.023489    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" containerName="manager"
Jul 23 15:15:45.023684 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.023672    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8fc4c7e-d62e-4e8c-b223-8d2b783eb5b9" containerName="manager"
Jul 23 15:15:45.027970 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.027944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.040957 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.040929    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 15:15:45.041090 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.040993    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 15:15:45.041179 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.041023    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c89l2\""
Jul 23 15:15:45.044314 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.044289    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd768775d-9d9pw"]
Jul 23 15:15:45.056387 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.056352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bznw2\" (UniqueName: \"kubernetes.io/projected/b7507609-bbbe-4c07-968a-25dc23f23a82-kube-api-access-bznw2\") pod \"maas-controller-6cd768775d-9d9pw\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") " pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.056509 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.056412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7507609-bbbe-4c07-968a-25dc23f23a82-webhook-cert\") pod \"maas-controller-6cd768775d-9d9pw\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") " pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.157702 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.157668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bznw2\" (UniqueName: \"kubernetes.io/projected/b7507609-bbbe-4c07-968a-25dc23f23a82-kube-api-access-bznw2\") pod \"maas-controller-6cd768775d-9d9pw\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") " pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.157886 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.157713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7507609-bbbe-4c07-968a-25dc23f23a82-webhook-cert\") pod \"maas-controller-6cd768775d-9d9pw\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") " pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.160181 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.160142    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7507609-bbbe-4c07-968a-25dc23f23a82-webhook-cert\") pod \"maas-controller-6cd768775d-9d9pw\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") " pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.171920 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.171892    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bznw2\" (UniqueName: \"kubernetes.io/projected/b7507609-bbbe-4c07-968a-25dc23f23a82-kube-api-access-bznw2\") pod \"maas-controller-6cd768775d-9d9pw\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") " pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.338340 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.338253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:45.696241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:45.696216    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd768775d-9d9pw"]
Jul 23 15:15:45.698592 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:15:45.698564    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7507609_bbbe_4c07_968a_25dc23f23a82.slice/crio-1f4829f6cddeb3520537082c80c7ffc60ae2022e5f678aa51c29e4ce3e3e20a7 WatchSource:0}: Error finding container 1f4829f6cddeb3520537082c80c7ffc60ae2022e5f678aa51c29e4ce3e3e20a7: Status 404 returned error can't find the container with id 1f4829f6cddeb3520537082c80c7ffc60ae2022e5f678aa51c29e4ce3e3e20a7
Jul 23 15:15:46.388404 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:46.388371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-9d9pw" event={"ID":"b7507609-bbbe-4c07-968a-25dc23f23a82","Type":"ContainerStarted","Data":"88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38"}
Jul 23 15:15:46.388878 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:46.388421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-9d9pw" event={"ID":"b7507609-bbbe-4c07-968a-25dc23f23a82","Type":"ContainerStarted","Data":"1f4829f6cddeb3520537082c80c7ffc60ae2022e5f678aa51c29e4ce3e3e20a7"}
Jul 23 15:15:46.388878 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:46.388452    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:15:46.410021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:46.409916    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cd768775d-9d9pw" podStartSLOduration=1.966098228 podStartE2EDuration="2.409901754s" totalImagesPullingTime="443.803526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:15:46.409399725 +0000 UTC m=+931.123331703" watchObservedRunningTime="2026-07-23 15:15:46.409901754 +0000 UTC m=+931.123833691"
Jul 23 15:15:57.395597 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:15:57.395565    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:16:02.052680 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.052644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:02.137937 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.137901    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cd768775d-9d9pw"]
Jul 23 15:16:02.138158 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.138134    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cd768775d-9d9pw" podUID="b7507609-bbbe-4c07-968a-25dc23f23a82" containerName="manager" containerID="cri-o://88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38" gracePeriod=30
Jul 23 15:16:02.396349 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.396323    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:16:02.467138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.467098    2575 generic.go:356] "Generic (PLEG): container finished" podID="b7507609-bbbe-4c07-968a-25dc23f23a82" containerID="88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38" exitCode=0
Jul 23 15:16:02.467344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.467144    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-9d9pw"
Jul 23 15:16:02.467344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.467145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-9d9pw" event={"ID":"b7507609-bbbe-4c07-968a-25dc23f23a82","Type":"ContainerDied","Data":"88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38"}
Jul 23 15:16:02.467344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.467239    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-9d9pw" event={"ID":"b7507609-bbbe-4c07-968a-25dc23f23a82","Type":"ContainerDied","Data":"1f4829f6cddeb3520537082c80c7ffc60ae2022e5f678aa51c29e4ce3e3e20a7"}
Jul 23 15:16:02.467344 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.467304    2575 scope.go:117] "RemoveContainer" containerID="88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38"
Jul 23 15:16:02.475771 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.475746    2575 scope.go:117] "RemoveContainer" containerID="88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38"
Jul 23 15:16:02.476030 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:16:02.476009    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38\": container with ID starting with 88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38 not found: ID does not exist" containerID="88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38"
Jul 23 15:16:02.476077 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.476044    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38"} err="failed to get container status \"88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38\": rpc error: code = NotFound desc = could not find container \"88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38\": container with ID starting with 88d60a7b3802ad5eb5d29431ae30172bea56960846cfe81e79e3586ee079ea38 not found: ID does not exist"
Jul 23 15:16:02.528128 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.528093    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bznw2\" (UniqueName: \"kubernetes.io/projected/b7507609-bbbe-4c07-968a-25dc23f23a82-kube-api-access-bznw2\") pod \"b7507609-bbbe-4c07-968a-25dc23f23a82\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") "
Jul 23 15:16:02.528350 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.528229    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7507609-bbbe-4c07-968a-25dc23f23a82-webhook-cert\") pod \"b7507609-bbbe-4c07-968a-25dc23f23a82\" (UID: \"b7507609-bbbe-4c07-968a-25dc23f23a82\") "
Jul 23 15:16:02.530407 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.530374    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7507609-bbbe-4c07-968a-25dc23f23a82-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b7507609-bbbe-4c07-968a-25dc23f23a82" (UID: "b7507609-bbbe-4c07-968a-25dc23f23a82"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:16:02.530529 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.530377    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7507609-bbbe-4c07-968a-25dc23f23a82-kube-api-access-bznw2" (OuterVolumeSpecName: "kube-api-access-bznw2") pod "b7507609-bbbe-4c07-968a-25dc23f23a82" (UID: "b7507609-bbbe-4c07-968a-25dc23f23a82"). InnerVolumeSpecName "kube-api-access-bznw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:16:02.629908 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.629823    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bznw2\" (UniqueName: \"kubernetes.io/projected/b7507609-bbbe-4c07-968a-25dc23f23a82-kube-api-access-bznw2\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:16:02.629908 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.629853    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7507609-bbbe-4c07-968a-25dc23f23a82-webhook-cert\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:16:02.793635 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.793592    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cd768775d-9d9pw"]
Jul 23 15:16:02.799894 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:02.799865    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cd768775d-9d9pw"]
Jul 23 15:16:03.748769 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.748731    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cd768775d-jh26n"]
Jul 23 15:16:03.749198 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.749182    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7507609-bbbe-4c07-968a-25dc23f23a82" containerName="manager"
Jul 23 15:16:03.749198 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.749199    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7507609-bbbe-4c07-968a-25dc23f23a82" containerName="manager"
Jul 23 15:16:03.749281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.749264    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7507609-bbbe-4c07-968a-25dc23f23a82" containerName="manager"
Jul 23 15:16:03.753589 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.753570    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:03.763929 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.763901    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 15:16:03.764071 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.763994    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 15:16:03.764150 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.764131    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c89l2\""
Jul 23 15:16:03.775764 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.775724    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd768775d-jh26n"]
Jul 23 15:16:03.840591 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.840551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d077c4a1-8845-4bf4-b9a6-f5d1a82074c9-webhook-cert\") pod \"maas-controller-6cd768775d-jh26n\" (UID: \"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9\") " pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:03.840758 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.840736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfhv8\" (UniqueName: \"kubernetes.io/projected/d077c4a1-8845-4bf4-b9a6-f5d1a82074c9-kube-api-access-jfhv8\") pod \"maas-controller-6cd768775d-jh26n\" (UID: \"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9\") " pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:03.866212 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.866156    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7507609-bbbe-4c07-968a-25dc23f23a82" path="/var/lib/kubelet/pods/b7507609-bbbe-4c07-968a-25dc23f23a82/volumes"
Jul 23 15:16:03.941543 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.941507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhv8\" (UniqueName: \"kubernetes.io/projected/d077c4a1-8845-4bf4-b9a6-f5d1a82074c9-kube-api-access-jfhv8\") pod \"maas-controller-6cd768775d-jh26n\" (UID: \"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9\") " pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:03.941543 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.941551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d077c4a1-8845-4bf4-b9a6-f5d1a82074c9-webhook-cert\") pod \"maas-controller-6cd768775d-jh26n\" (UID: \"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9\") " pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:03.944312 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.944283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d077c4a1-8845-4bf4-b9a6-f5d1a82074c9-webhook-cert\") pod \"maas-controller-6cd768775d-jh26n\" (UID: \"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9\") " pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:03.952868 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:03.952839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfhv8\" (UniqueName: \"kubernetes.io/projected/d077c4a1-8845-4bf4-b9a6-f5d1a82074c9-kube-api-access-jfhv8\") pod \"maas-controller-6cd768775d-jh26n\" (UID: \"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9\") " pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:04.064367 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:04.064279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:04.074420 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:04.074391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:04.215194 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:04.215147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd768775d-jh26n"]
Jul 23 15:16:04.219151 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:16:04.219124    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd077c4a1_8845_4bf4_b9a6_f5d1a82074c9.slice/crio-28ee6130ef44de2947ca92680fb539b8432d7d632ebd91558252f4fd5a7eb94d WatchSource:0}: Error finding container 28ee6130ef44de2947ca92680fb539b8432d7d632ebd91558252f4fd5a7eb94d: Status 404 returned error can't find the container with id 28ee6130ef44de2947ca92680fb539b8432d7d632ebd91558252f4fd5a7eb94d
Jul 23 15:16:04.479104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:04.479068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-jh26n" event={"ID":"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9","Type":"ContainerStarted","Data":"28ee6130ef44de2947ca92680fb539b8432d7d632ebd91558252f4fd5a7eb94d"}
Jul 23 15:16:05.485856 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:05.485822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd768775d-jh26n" event={"ID":"d077c4a1-8845-4bf4-b9a6-f5d1a82074c9","Type":"ContainerStarted","Data":"687db926ac0a2b44aac5d7cbef95a458180aae304edebaadc59db51703a852c7"}
Jul 23 15:16:05.486281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:05.485886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:05.517111 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:05.517059    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cd768775d-jh26n" podStartSLOduration=1.956978446 podStartE2EDuration="2.517044165s" totalImagesPullingTime="560.065719ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:16:05.512786131 +0000 UTC m=+950.226718065" watchObservedRunningTime="2026-07-23 15:16:05.517044165 +0000 UTC m=+950.230976101"
Jul 23 15:16:15.860791 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:15.860757    2575 scope.go:117] "RemoveContainer" containerID="161c7bccfcca545095c4707596cc13575252d11f647866d4f19e8deffe0895eb"
Jul 23 15:16:16.492979 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:16.492945    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cd768775d-jh26n"
Jul 23 15:16:38.343152 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:38.343054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:38.447877 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:38.447847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:38.576008 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:38.575948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:44.783818 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:44.783767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:44.886793 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:44.886762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:44.984995 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:44.984962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:45.159964 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:45.159874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:51.485493 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:51.485447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:16:51.595322 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:16:51.595286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:17:44.880639 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:17:44.880603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:21:40.839113 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:21:40.839037    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:21:57.629521 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:21:57.629484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:24:41.863240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:24:41.863146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:24:49.520319 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:24:49.520261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:25:06.435082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:25:06.435038    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:25:24.020375 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:25:24.020338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:25:24.623041 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:25:24.623008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:26:30.647595 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:26:30.647562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:26:43.529069 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:26:43.529027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:26:44.672080 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:26:44.672044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:26.150841 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:26.150764    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:47.745742 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:47.745657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:50.803885 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:50.803846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:50.903992 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:50.903956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:51.269968 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:51.269934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:57.288959 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:57.288914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:57.349846 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:57.349812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:57.552136 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:57.552045    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:57.953144 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:57.953090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:28:58.283695 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:28:58.283601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:00.515776 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.515738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:00.612099 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.612065    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:00.715331 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.715294    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"]
Jul 23 15:29:00.718966 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.718943    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.721869 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.721846    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a349867e-serving-cert\""
Jul 23 15:29:00.728987 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.728962    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"]
Jul 23 15:29:00.749387 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.749354    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:00.881458 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.881366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ecd4332-cafc-458b-acef-8863e4f4308a-openshift-service-ca\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.881458 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.881408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5h7\" (UniqueName: \"kubernetes.io/projected/8ecd4332-cafc-458b-acef-8863e4f4308a-kube-api-access-dt5h7\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.881707 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.881491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ecd4332-cafc-458b-acef-8863e4f4308a-maas-api-tls\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.943594 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.943557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:00.982931 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.982892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ecd4332-cafc-458b-acef-8863e4f4308a-openshift-service-ca\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.983289 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.983257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5h7\" (UniqueName: \"kubernetes.io/projected/8ecd4332-cafc-458b-acef-8863e4f4308a-kube-api-access-dt5h7\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.983539 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.983513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ecd4332-cafc-458b-acef-8863e4f4308a-maas-api-tls\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.983719 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.983697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ecd4332-cafc-458b-acef-8863e4f4308a-openshift-service-ca\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.985903 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.985882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ecd4332-cafc-458b-acef-8863e4f4308a-maas-api-tls\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:00.992449 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:00.992423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5h7\" (UniqueName: \"kubernetes.io/projected/8ecd4332-cafc-458b-acef-8863e4f4308a-kube-api-access-dt5h7\") pod \"maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:01.030201 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:01.030145    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:01.174245 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:01.174162    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"]
Jul 23 15:29:01.176676 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:29:01.176635    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecd4332_cafc_458b_acef_8863e4f4308a.slice/crio-5d125ad2a91305138892d3766466840b53ead2e75afe455fb425fd50d71627d0 WatchSource:0}: Error finding container 5d125ad2a91305138892d3766466840b53ead2e75afe455fb425fd50d71627d0: Status 404 returned error can't find the container with id 5d125ad2a91305138892d3766466840b53ead2e75afe455fb425fd50d71627d0
Jul 23 15:29:01.178272 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:01.178252    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:29:01.308792 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:01.308758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:01.324973 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:01.324941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq" event={"ID":"8ecd4332-cafc-458b-acef-8863e4f4308a","Type":"ContainerStarted","Data":"5d125ad2a91305138892d3766466840b53ead2e75afe455fb425fd50d71627d0"}
Jul 23 15:29:01.409766 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:01.409729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:03.342219 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:03.342161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq" event={"ID":"8ecd4332-cafc-458b-acef-8863e4f4308a","Type":"ContainerStarted","Data":"14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d"}
Jul 23 15:29:03.342710 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:03.342280    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:03.367533 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:03.362405    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq" podStartSLOduration=1.887284353 podStartE2EDuration="3.362384382s" totalImagesPullingTime="1.475100029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:29:03.361436483 +0000 UTC m=+1728.075368439" watchObservedRunningTime="2026-07-23 15:29:03.362384382 +0000 UTC m=+1728.076316320"
Jul 23 15:29:09.353318 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:09.353289    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:36.770648 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:36.770609    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"]
Jul 23 15:29:36.771259 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:36.770963    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq" podUID="8ecd4332-cafc-458b-acef-8863e4f4308a" containerName="maas-api" containerID="cri-o://14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d" gracePeriod=30
Jul 23 15:29:36.797057 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:36.797022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:37.025079 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.025012    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:37.125795 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.125762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt5h7\" (UniqueName: \"kubernetes.io/projected/8ecd4332-cafc-458b-acef-8863e4f4308a-kube-api-access-dt5h7\") pod \"8ecd4332-cafc-458b-acef-8863e4f4308a\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") "
Jul 23 15:29:37.126000 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.125842    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ecd4332-cafc-458b-acef-8863e4f4308a-maas-api-tls\") pod \"8ecd4332-cafc-458b-acef-8863e4f4308a\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") "
Jul 23 15:29:37.126000 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.125899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ecd4332-cafc-458b-acef-8863e4f4308a-openshift-service-ca\") pod \"8ecd4332-cafc-458b-acef-8863e4f4308a\" (UID: \"8ecd4332-cafc-458b-acef-8863e4f4308a\") "
Jul 23 15:29:37.126321 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.126288    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ecd4332-cafc-458b-acef-8863e4f4308a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ecd4332-cafc-458b-acef-8863e4f4308a" (UID: "8ecd4332-cafc-458b-acef-8863e4f4308a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:29:37.128112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.128086    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ecd4332-cafc-458b-acef-8863e4f4308a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ecd4332-cafc-458b-acef-8863e4f4308a" (UID: "8ecd4332-cafc-458b-acef-8863e4f4308a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:29:37.128240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.128089    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecd4332-cafc-458b-acef-8863e4f4308a-kube-api-access-dt5h7" (OuterVolumeSpecName: "kube-api-access-dt5h7") pod "8ecd4332-cafc-458b-acef-8863e4f4308a" (UID: "8ecd4332-cafc-458b-acef-8863e4f4308a"). InnerVolumeSpecName "kube-api-access-dt5h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:29:37.227493 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.227455    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt5h7\" (UniqueName: \"kubernetes.io/projected/8ecd4332-cafc-458b-acef-8863e4f4308a-kube-api-access-dt5h7\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:29:37.227493 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.227489    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ecd4332-cafc-458b-acef-8863e4f4308a-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:29:37.227493 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.227507    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ecd4332-cafc-458b-acef-8863e4f4308a-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:29:37.521233 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.521195    2575 generic.go:356] "Generic (PLEG): container finished" podID="8ecd4332-cafc-458b-acef-8863e4f4308a" containerID="14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d" exitCode=0
Jul 23 15:29:37.521422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.521297    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"
Jul 23 15:29:37.521422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.521337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq" event={"ID":"8ecd4332-cafc-458b-acef-8863e4f4308a","Type":"ContainerDied","Data":"14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d"}
Jul 23 15:29:37.521422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.521393    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq" event={"ID":"8ecd4332-cafc-458b-acef-8863e4f4308a","Type":"ContainerDied","Data":"5d125ad2a91305138892d3766466840b53ead2e75afe455fb425fd50d71627d0"}
Jul 23 15:29:37.521422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.521416    2575 scope.go:117] "RemoveContainer" containerID="14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d"
Jul 23 15:29:37.530440 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.530423    2575 scope.go:117] "RemoveContainer" containerID="14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d"
Jul 23 15:29:37.530718 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:29:37.530696    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d\": container with ID starting with 14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d not found: ID does not exist" containerID="14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d"
Jul 23 15:29:37.530798 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.530726    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d"} err="failed to get container status \"14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d\": rpc error: code = NotFound desc = could not find container \"14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d\": container with ID starting with 14e8da0fa605148816917534feb55ba67aca3f0a76a6196f2f5d027b2790eb8d not found: ID does not exist"
Jul 23 15:29:37.544930 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.544901    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"]
Jul 23 15:29:37.549379 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.549356    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a349867e-68b6cd7b94-9xsfq"]
Jul 23 15:29:37.866354 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:37.866276    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ecd4332-cafc-458b-acef-8863e4f4308a" path="/var/lib/kubelet/pods/8ecd4332-cafc-458b-acef-8863e4f4308a/volumes"
Jul 23 15:29:41.245236 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:41.245201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:41.412836 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:41.412800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:41.637577 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:41.637491    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:42.372126 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:42.372073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:42.480139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:42.480103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:42.573736 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:42.573689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:42.680128 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:42.680088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:44.830067 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.830020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:44.914060 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.914022    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"]
Jul 23 15:29:44.914666 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.914647    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ecd4332-cafc-458b-acef-8863e4f4308a" containerName="maas-api"
Jul 23 15:29:44.914714 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.914671    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ecd4332-cafc-458b-acef-8863e4f4308a" containerName="maas-api"
Jul 23 15:29:44.914814 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.914800    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ecd4332-cafc-458b-acef-8863e4f4308a" containerName="maas-api"
Jul 23 15:29:44.919651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.919630    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:44.922809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.922790    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-37799938-serving-cert\""
Jul 23 15:29:44.927853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.927830    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"]
Jul 23 15:29:44.956472 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:44.956421    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:45.004609 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.004576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e101f3-4686-4521-bcdd-5e7b64ffe180-openshift-service-ca\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.004800 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.004617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr9z2\" (UniqueName: \"kubernetes.io/projected/b6e101f3-4686-4521-bcdd-5e7b64ffe180-kube-api-access-xr9z2\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.004800 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.004686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.105904 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.105791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e101f3-4686-4521-bcdd-5e7b64ffe180-openshift-service-ca\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.105904 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.105857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr9z2\" (UniqueName: \"kubernetes.io/projected/b6e101f3-4686-4521-bcdd-5e7b64ffe180-kube-api-access-xr9z2\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.106139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.105946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.106139 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:29:45.106055    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-serving-cert: secret "maas-api-e2e-migrate-37799938-serving-cert" not found
Jul 23 15:29:45.106139 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:29:45.106115    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls podName:b6e101f3-4686-4521-bcdd-5e7b64ffe180 nodeName:}" failed. No retries permitted until 2026-07-23 15:29:45.606099471 +0000 UTC m=+1770.320031386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls") pod "maas-api-e2e-migrate-37799938-6b6796d7bf-782mt" (UID: "b6e101f3-4686-4521-bcdd-5e7b64ffe180") : secret "maas-api-e2e-migrate-37799938-serving-cert" not found
Jul 23 15:29:45.106453 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.106433    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e101f3-4686-4521-bcdd-5e7b64ffe180-openshift-service-ca\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.115028 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.115001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr9z2\" (UniqueName: \"kubernetes.io/projected/b6e101f3-4686-4521-bcdd-5e7b64ffe180-kube-api-access-xr9z2\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.449205 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.449148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:45.546568 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.546525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:45.612289 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.612257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.614597 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.614569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls\") pod \"maas-api-e2e-migrate-37799938-6b6796d7bf-782mt\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.643774 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.643736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:45.830869 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.830768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:45.989824 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:45.989799    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"]
Jul 23 15:29:45.992548 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:29:45.992521    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e101f3_4686_4521_bcdd_5e7b64ffe180.slice/crio-ebf265d27bdc742d65752da9fe5d454eb1ecb27a3d76704b43fb5ca1aaddd1f4 WatchSource:0}: Error finding container ebf265d27bdc742d65752da9fe5d454eb1ecb27a3d76704b43fb5ca1aaddd1f4: Status 404 returned error can't find the container with id ebf265d27bdc742d65752da9fe5d454eb1ecb27a3d76704b43fb5ca1aaddd1f4
Jul 23 15:29:46.569358 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:46.569319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt" event={"ID":"b6e101f3-4686-4521-bcdd-5e7b64ffe180","Type":"ContainerStarted","Data":"9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f"}
Jul 23 15:29:46.569546 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:46.569369    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt" event={"ID":"b6e101f3-4686-4521-bcdd-5e7b64ffe180","Type":"ContainerStarted","Data":"ebf265d27bdc742d65752da9fe5d454eb1ecb27a3d76704b43fb5ca1aaddd1f4"}
Jul 23 15:29:46.569546 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:46.569415    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:29:46.589190 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:46.589062    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt" podStartSLOduration=2.256993153 podStartE2EDuration="2.589035916s" totalImagesPullingTime="332.042763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:29:46.58724697 +0000 UTC m=+1771.301178939" watchObservedRunningTime="2026-07-23 15:29:46.589035916 +0000 UTC m=+1771.302967853"
Jul 23 15:29:47.380264 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:47.380222    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:29:52.579884 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:29:52.579855    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:30:20.461146 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.461100    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"]
Jul 23 15:30:20.461651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.461379    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt" podUID="b6e101f3-4686-4521-bcdd-5e7b64ffe180" containerName="maas-api" containerID="cri-o://9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f" gracePeriod=30
Jul 23 15:30:20.482387 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.482360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:20.718000 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.717940    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:30:20.741041 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.741003    2575 generic.go:356] "Generic (PLEG): container finished" podID="b6e101f3-4686-4521-bcdd-5e7b64ffe180" containerID="9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f" exitCode=0
Jul 23 15:30:20.741239 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.741050    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"
Jul 23 15:30:20.741239 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.741086    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt" event={"ID":"b6e101f3-4686-4521-bcdd-5e7b64ffe180","Type":"ContainerDied","Data":"9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f"}
Jul 23 15:30:20.741239 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.741145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt" event={"ID":"b6e101f3-4686-4521-bcdd-5e7b64ffe180","Type":"ContainerDied","Data":"ebf265d27bdc742d65752da9fe5d454eb1ecb27a3d76704b43fb5ca1aaddd1f4"}
Jul 23 15:30:20.741239 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.741199    2575 scope.go:117] "RemoveContainer" containerID="9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f"
Jul 23 15:30:20.751219 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.751150    2575 scope.go:117] "RemoveContainer" containerID="9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f"
Jul 23 15:30:20.751533 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:30:20.751510    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f\": container with ID starting with 9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f not found: ID does not exist" containerID="9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f"
Jul 23 15:30:20.751620 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.751546    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f"} err="failed to get container status \"9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f\": rpc error: code = NotFound desc = could not find container \"9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f\": container with ID starting with 9bd49754458999571ad97445ab2b97537563328a56c59031bf85fa55991f6e1f not found: ID does not exist"
Jul 23 15:30:20.846207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.846162    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls\") pod \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") "
Jul 23 15:30:20.846404 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.846233    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e101f3-4686-4521-bcdd-5e7b64ffe180-openshift-service-ca\") pod \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") "
Jul 23 15:30:20.846404 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.846350    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr9z2\" (UniqueName: \"kubernetes.io/projected/b6e101f3-4686-4521-bcdd-5e7b64ffe180-kube-api-access-xr9z2\") pod \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\" (UID: \"b6e101f3-4686-4521-bcdd-5e7b64ffe180\") "
Jul 23 15:30:20.846639 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.846616    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e101f3-4686-4521-bcdd-5e7b64ffe180-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6e101f3-4686-4521-bcdd-5e7b64ffe180" (UID: "b6e101f3-4686-4521-bcdd-5e7b64ffe180"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:30:20.848454 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.848420    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6e101f3-4686-4521-bcdd-5e7b64ffe180" (UID: "b6e101f3-4686-4521-bcdd-5e7b64ffe180"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:30:20.848569 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.848520    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e101f3-4686-4521-bcdd-5e7b64ffe180-kube-api-access-xr9z2" (OuterVolumeSpecName: "kube-api-access-xr9z2") pod "b6e101f3-4686-4521-bcdd-5e7b64ffe180" (UID: "b6e101f3-4686-4521-bcdd-5e7b64ffe180"). InnerVolumeSpecName "kube-api-access-xr9z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:30:20.947434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.947402    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr9z2\" (UniqueName: \"kubernetes.io/projected/b6e101f3-4686-4521-bcdd-5e7b64ffe180-kube-api-access-xr9z2\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:30:20.947434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.947429    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6e101f3-4686-4521-bcdd-5e7b64ffe180-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:30:20.947434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:20.947438    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6e101f3-4686-4521-bcdd-5e7b64ffe180-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:30:21.065517 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:21.065486    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"]
Jul 23 15:30:21.069393 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:21.069364    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-37799938-6b6796d7bf-782mt"]
Jul 23 15:30:21.866748 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:21.866700    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e101f3-4686-4521-bcdd-5e7b64ffe180" path="/var/lib/kubelet/pods/b6e101f3-4686-4521-bcdd-5e7b64ffe180/volumes"
Jul 23 15:30:24.949890 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:24.949854    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:25.130594 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:25.130560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:25.374958 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:25.374867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:25.636482 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:25.636393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:25.968187 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:25.968141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:26.178876 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:26.178838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:28.028721 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.028684    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:28.104753 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.104707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"]
Jul 23 15:30:28.105145 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.105128    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e101f3-4686-4521-bcdd-5e7b64ffe180" containerName="maas-api"
Jul 23 15:30:28.105145 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.105144    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e101f3-4686-4521-bcdd-5e7b64ffe180" containerName="maas-api"
Jul 23 15:30:28.105310 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.105251    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e101f3-4686-4521-bcdd-5e7b64ffe180" containerName="maas-api"
Jul 23 15:30:28.109693 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.109671    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.112453 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.112430    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6c19891e-serving-cert\""
Jul 23 15:30:28.119076 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.119051    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"]
Jul 23 15:30:28.224276 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.224237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-openshift-service-ca\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.224605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.224580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chjd5\" (UniqueName: \"kubernetes.io/projected/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-kube-api-access-chjd5\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.224742 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.224622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-maas-api-tls\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.325302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.325205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-openshift-service-ca\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.325302 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.325303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chjd5\" (UniqueName: \"kubernetes.io/projected/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-kube-api-access-chjd5\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.325492 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.325321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-maas-api-tls\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.325951 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.325928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-openshift-service-ca\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.327784 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.327761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-maas-api-tls\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.337624 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.337596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chjd5\" (UniqueName: \"kubernetes.io/projected/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-kube-api-access-chjd5\") pod \"maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.421160 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.421116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:28.538451 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.538420    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:28.566673 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.566644    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"]
Jul 23 15:30:28.568854 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:30:28.568829    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6467b37c_bc9c_4dd4_89bc_9f7569ce31b2.slice/crio-e6c36ce7df9492731d50901d653808e965b07b8b09527c8de9d3b985e953fd51 WatchSource:0}: Error finding container e6c36ce7df9492731d50901d653808e965b07b8b09527c8de9d3b985e953fd51: Status 404 returned error can't find the container with id e6c36ce7df9492731d50901d653808e965b07b8b09527c8de9d3b985e953fd51
Jul 23 15:30:28.636468 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.636375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:28.750400 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.750354    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:28.784260 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.784224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv" event={"ID":"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2","Type":"ContainerStarted","Data":"e6c36ce7df9492731d50901d653808e965b07b8b09527c8de9d3b985e953fd51"}
Jul 23 15:30:28.849800 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:28.849764    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:30:29.792429 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:29.792398    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv" event={"ID":"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2","Type":"ContainerStarted","Data":"210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7"}
Jul 23 15:30:29.792798 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:29.792462    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:30:29.811033 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:29.810988    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv" podStartSLOduration=1.33912638 podStartE2EDuration="1.810967543s" totalImagesPullingTime="471.841163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:30:29.809801594 +0000 UTC m=+1814.523733539" watchObservedRunningTime="2026-07-23 15:30:29.810967543 +0000 UTC m=+1814.524899481"
Jul 23 15:30:35.802929 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:30:35.802900    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:31:04.325949 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.325904    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"]
Jul 23 15:31:04.326562 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.326186    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv" podUID="6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" containerName="maas-api" containerID="cri-o://210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7" gracePeriod=30
Jul 23 15:31:04.355463 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.355417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:04.580991 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.580927    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:31:04.675602 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.675563    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chjd5\" (UniqueName: \"kubernetes.io/projected/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-kube-api-access-chjd5\") pod \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") "
Jul 23 15:31:04.675808 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.675630    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-openshift-service-ca\") pod \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") "
Jul 23 15:31:04.675808 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.675686    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-maas-api-tls\") pod \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\" (UID: \"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2\") "
Jul 23 15:31:04.676043 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.676018    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" (UID: "6467b37c-bc9c-4dd4-89bc-9f7569ce31b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:31:04.677853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.677829    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" (UID: "6467b37c-bc9c-4dd4-89bc-9f7569ce31b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:31:04.677982 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.677956    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-kube-api-access-chjd5" (OuterVolumeSpecName: "kube-api-access-chjd5") pod "6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" (UID: "6467b37c-bc9c-4dd4-89bc-9f7569ce31b2"). InnerVolumeSpecName "kube-api-access-chjd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:31:04.776761 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.776722    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chjd5\" (UniqueName: \"kubernetes.io/projected/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-kube-api-access-chjd5\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:31:04.776761 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.776753    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:31:04.776761 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.776765    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:31:04.968666 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.968632    2575 generic.go:356] "Generic (PLEG): container finished" podID="6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" containerID="210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7" exitCode=0
Jul 23 15:31:04.968854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.968681    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"
Jul 23 15:31:04.968854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.968674    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv" event={"ID":"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2","Type":"ContainerDied","Data":"210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7"}
Jul 23 15:31:04.968854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.968794    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv" event={"ID":"6467b37c-bc9c-4dd4-89bc-9f7569ce31b2","Type":"ContainerDied","Data":"e6c36ce7df9492731d50901d653808e965b07b8b09527c8de9d3b985e953fd51"}
Jul 23 15:31:04.968854 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.968818    2575 scope.go:117] "RemoveContainer" containerID="210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7"
Jul 23 15:31:04.978401 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.978386    2575 scope.go:117] "RemoveContainer" containerID="210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7"
Jul 23 15:31:04.978670 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:31:04.978652    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7\": container with ID starting with 210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7 not found: ID does not exist" containerID="210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7"
Jul 23 15:31:04.978738 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.978680    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7"} err="failed to get container status \"210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7\": rpc error: code = NotFound desc = could not find container \"210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7\": container with ID starting with 210ea2612be90e5fd4079285dd7e421acf0b3233a392e80ba1b70a4fc51816e7 not found: ID does not exist"
Jul 23 15:31:04.992242 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.992214    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"]
Jul 23 15:31:04.996484 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:04.996460    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c19891e-7f5d44d99f-vq9xv"]
Jul 23 15:31:05.867238 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:05.867206    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" path="/var/lib/kubelet/pods/6467b37c-bc9c-4dd4-89bc-9f7569ce31b2/volumes"
Jul 23 15:31:08.893749 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:08.893717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:10.151016 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:10.150971    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:10.373929 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:10.373891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:11.500301 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:11.500264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:11.601107 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:11.601069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:13.155081 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.155048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:13.237604 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.237568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:13.241909 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.241870    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"]
Jul 23 15:31:13.242556 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.242533    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" containerName="maas-api"
Jul 23 15:31:13.242556 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.242555    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" containerName="maas-api"
Jul 23 15:31:13.242721 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.242667    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467b37c-bc9c-4dd4-89bc-9f7569ce31b2" containerName="maas-api"
Jul 23 15:31:13.247788 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.247758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.250287 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.250264    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ad9a66fd-serving-cert\""
Jul 23 15:31:13.255565 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.255537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"]
Jul 23 15:31:13.263545 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.263521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-openshift-service-ca\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.263665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.263561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.263665 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.263615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8sd\" (UniqueName: \"kubernetes.io/projected/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-kube-api-access-8w8sd\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.302763 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.302707    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:13.365155 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.365113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-openshift-service-ca\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.365371 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.365207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.365371 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.365257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8sd\" (UniqueName: \"kubernetes.io/projected/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-kube-api-access-8w8sd\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.365371 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:31:13.365351    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-serving-cert: secret "maas-api-e2e-derive-ad9a66fd-serving-cert" not found
Jul 23 15:31:13.365538 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:31:13.365434    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls podName:d1ca2ceb-5b95-4277-b317-03a6f3f2af2c nodeName:}" failed. No retries permitted until 2026-07-23 15:31:13.865410979 +0000 UTC m=+1858.579342903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls") pod "maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s" (UID: "d1ca2ceb-5b95-4277-b317-03a6f3f2af2c") : secret "maas-api-e2e-derive-ad9a66fd-serving-cert" not found
Jul 23 15:31:13.365869 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.365850    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-openshift-service-ca\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.376501 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.376471    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8sd\" (UniqueName: \"kubernetes.io/projected/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-kube-api-access-8w8sd\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.692759 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.692721    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:13.798488 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.798446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:13.869590 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.869560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.872190 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.872149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls\") pod \"maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:13.890321 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:13.890289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:14.160609 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:14.160518    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:14.507295 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:14.507263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"]
Jul 23 15:31:14.509409 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:31:14.509378    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ca2ceb_5b95_4277_b317_03a6f3f2af2c.slice/crio-b46143361065f57f7f32bb27fb2edbcce9ec3e59cf234cdacea3585ecca26234 WatchSource:0}: Error finding container b46143361065f57f7f32bb27fb2edbcce9ec3e59cf234cdacea3585ecca26234: Status 404 returned error can't find the container with id b46143361065f57f7f32bb27fb2edbcce9ec3e59cf234cdacea3585ecca26234
Jul 23 15:31:15.024658 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:15.024618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s" event={"ID":"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c","Type":"ContainerStarted","Data":"833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a"}
Jul 23 15:31:15.024850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:15.024682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s" event={"ID":"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c","Type":"ContainerStarted","Data":"b46143361065f57f7f32bb27fb2edbcce9ec3e59cf234cdacea3585ecca26234"}
Jul 23 15:31:15.024850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:15.024714    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:15.043307 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:15.043258    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s" podStartSLOduration=1.642802074 podStartE2EDuration="2.043242449s" totalImagesPullingTime="400.440375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:31:15.041699529 +0000 UTC m=+1859.755631467" watchObservedRunningTime="2026-07-23 15:31:15.043242449 +0000 UTC m=+1859.757174440"
Jul 23 15:31:21.040749 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:21.040718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:25.382459 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:25.382413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:25.478007 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:25.477949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:27.831481 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:27.831444    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:34.740925 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:34.740893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:34.843388 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:34.843355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:48.537706 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.537498    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"]
Jul 23 15:31:48.538830 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.538791    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s" podUID="d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" containerName="maas-api" containerID="cri-o://833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a" gracePeriod=30
Jul 23 15:31:48.569041 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.568997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:48.801074 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.801011    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:48.911201 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.911137    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w8sd\" (UniqueName: \"kubernetes.io/projected/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-kube-api-access-8w8sd\") pod \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") "
Jul 23 15:31:48.911389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.911232    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls\") pod \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") "
Jul 23 15:31:48.911389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.911348    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-openshift-service-ca\") pod \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\" (UID: \"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c\") "
Jul 23 15:31:48.911658 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.911628    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" (UID: "d1ca2ceb-5b95-4277-b317-03a6f3f2af2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:31:48.913330 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.913304    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" (UID: "d1ca2ceb-5b95-4277-b317-03a6f3f2af2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:31:48.913442 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:48.913326    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-kube-api-access-8w8sd" (OuterVolumeSpecName: "kube-api-access-8w8sd") pod "d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" (UID: "d1ca2ceb-5b95-4277-b317-03a6f3f2af2c"). InnerVolumeSpecName "kube-api-access-8w8sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:31:49.013098 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.013053    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:31:49.013098 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.013088    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w8sd\" (UniqueName: \"kubernetes.io/projected/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-kube-api-access-8w8sd\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:31:49.013098 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.013100    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:31:49.201906 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.201868    2575 generic.go:356] "Generic (PLEG): container finished" podID="d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" containerID="833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a" exitCode=0
Jul 23 15:31:49.202085 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.201912    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"
Jul 23 15:31:49.202085 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.201957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s" event={"ID":"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c","Type":"ContainerDied","Data":"833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a"}
Jul 23 15:31:49.202085 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.202002    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s" event={"ID":"d1ca2ceb-5b95-4277-b317-03a6f3f2af2c","Type":"ContainerDied","Data":"b46143361065f57f7f32bb27fb2edbcce9ec3e59cf234cdacea3585ecca26234"}
Jul 23 15:31:49.202085 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.202024    2575 scope.go:117] "RemoveContainer" containerID="833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a"
Jul 23 15:31:49.211757 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.211737    2575 scope.go:117] "RemoveContainer" containerID="833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a"
Jul 23 15:31:49.212029 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:31:49.212009    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a\": container with ID starting with 833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a not found: ID does not exist" containerID="833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a"
Jul 23 15:31:49.212097 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.212043    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a"} err="failed to get container status \"833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a\": rpc error: code = NotFound desc = could not find container \"833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a\": container with ID starting with 833fbbfc4baff225db27b77af9843adb313621b1fb1b0a09f7609f205837141a not found: ID does not exist"
Jul 23 15:31:49.225071 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.225027    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"]
Jul 23 15:31:49.228359 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.228335    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ad9a66fd-58ddc8b9bf-9b47s"]
Jul 23 15:31:49.866578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:49.866543    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" path="/var/lib/kubelet/pods/d1ca2ceb-5b95-4277-b317-03a6f3f2af2c/volumes"
Jul 23 15:31:53.407715 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:53.407676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:53.492623 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:53.492585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:53.585471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:53.585429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:54.092353 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:54.092315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:54.187823 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:54.187788    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:54.287752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:54.287689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:31:55.761490 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:31:55.761453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:02.795247 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:02.795207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:02.897741 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:02.897691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:03.000207 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:03.000145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:08.565322 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:08.565286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:34.562098 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:34.562056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:40.987884 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:40.987850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:41.111434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:41.111397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:41.214320 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:41.214279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:32:57.093974 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:32:57.093931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:03.051133 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:03.051093    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:04.780275 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:04.780239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:04.883216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:04.883158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:10.028462 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:10.028381    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:13.771481 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:13.771448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:14.599856 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:14.599822    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:21.648325 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:21.648289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:21.750675 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:21.750633    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:21.850809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:21.850774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:21.950358 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:21.950322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:22.787462 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:22.787415    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:22.893112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:22.893081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:22.982796 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:22.982762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:24.601186 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:24.601145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:30.805962 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:30.805920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:30.905406 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:30.905371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:31.526328 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:31.526293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:38.255682 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:38.255649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:38.360687 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:38.360653    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:38.536091 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:38.535994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:38.844641 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:38.844544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:39.192228 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:39.192190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:42.021318 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.021271    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"]
Jul 23 15:33:42.021949 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.021925    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" containerName="maas-api"
Jul 23 15:33:42.021949 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.021948    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" containerName="maas-api"
Jul 23 15:33:42.022145 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.022023    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ca2ceb-5b95-4277-b317-03a6f3f2af2c" containerName="maas-api"
Jul 23 15:33:42.025459 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.025441    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.027912 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.027894    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9a77be01-serving-cert\""
Jul 23 15:33:42.036740 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.036717    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"]
Jul 23 15:33:42.187762 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.187723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fghz\" (UniqueName: \"kubernetes.io/projected/0ba6f637-cb5c-49a0-939a-de7b588d583f-kube-api-access-4fghz\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.187962 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.187774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6f637-cb5c-49a0-939a-de7b588d583f-openshift-service-ca\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.187962 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.187889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ba6f637-cb5c-49a0-939a-de7b588d583f-maas-api-tls\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.288599 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.288500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fghz\" (UniqueName: \"kubernetes.io/projected/0ba6f637-cb5c-49a0-939a-de7b588d583f-kube-api-access-4fghz\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.288599 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.288551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6f637-cb5c-49a0-939a-de7b588d583f-openshift-service-ca\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.288832 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.288608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ba6f637-cb5c-49a0-939a-de7b588d583f-maas-api-tls\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.289216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.289163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6f637-cb5c-49a0-939a-de7b588d583f-openshift-service-ca\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.291050 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.291022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ba6f637-cb5c-49a0-939a-de7b588d583f-maas-api-tls\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.296832 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.296801    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fghz\" (UniqueName: \"kubernetes.io/projected/0ba6f637-cb5c-49a0-939a-de7b588d583f-kube-api-access-4fghz\") pod \"maas-api-e2e-mt-9a77be01-78d85488c6-gjblv\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.336853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.336819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:42.489651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.489625    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"]
Jul 23 15:33:42.492423 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:33:42.492389    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba6f637_cb5c_49a0_939a_de7b588d583f.slice/crio-98382fa1857753e1d0d600e2ba8ef9e5aa08a12e56420d27954b9f2fc8faea4a WatchSource:0}: Error finding container 98382fa1857753e1d0d600e2ba8ef9e5aa08a12e56420d27954b9f2fc8faea4a: Status 404 returned error can't find the container with id 98382fa1857753e1d0d600e2ba8ef9e5aa08a12e56420d27954b9f2fc8faea4a
Jul 23 15:33:42.565998 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.565897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:42.665730 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.665695    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:42.764797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.764756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv" event={"ID":"0ba6f637-cb5c-49a0-939a-de7b588d583f","Type":"ContainerStarted","Data":"98382fa1857753e1d0d600e2ba8ef9e5aa08a12e56420d27954b9f2fc8faea4a"}
Jul 23 15:33:42.769121 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:42.769090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:43.771124 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:43.771083    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv" event={"ID":"0ba6f637-cb5c-49a0-939a-de7b588d583f","Type":"ContainerStarted","Data":"2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b"}
Jul 23 15:33:43.771545 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:43.771224    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:43.791117 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:43.791063    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv" podStartSLOduration=2.18645258 podStartE2EDuration="2.791044235s" totalImagesPullingTime="604.591655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:33:43.789650982 +0000 UTC m=+2008.503582921" watchObservedRunningTime="2026-07-23 15:33:43.791044235 +0000 UTC m=+2008.504976172"
Jul 23 15:33:46.336894 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:46.336836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:46.982105 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:46.982066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:47.078860 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:47.078823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:47.447708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:47.447669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:49.782271 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:49.782239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:33:53.405457 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:53.405414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:33:53.503591 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:33:53.503553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:04.164407 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.164371    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"]
Jul 23 15:34:04.164805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.164630    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv" podUID="0ba6f637-cb5c-49a0-939a-de7b588d583f" containerName="maas-api" containerID="cri-o://2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b" gracePeriod=30
Jul 23 15:34:04.217201 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.217141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:04.416884 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.416828    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:34:04.507497 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.507401    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fghz\" (UniqueName: \"kubernetes.io/projected/0ba6f637-cb5c-49a0-939a-de7b588d583f-kube-api-access-4fghz\") pod \"0ba6f637-cb5c-49a0-939a-de7b588d583f\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") "
Jul 23 15:34:04.507697 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.507531    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6f637-cb5c-49a0-939a-de7b588d583f-openshift-service-ca\") pod \"0ba6f637-cb5c-49a0-939a-de7b588d583f\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") "
Jul 23 15:34:04.507697 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.507560    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ba6f637-cb5c-49a0-939a-de7b588d583f-maas-api-tls\") pod \"0ba6f637-cb5c-49a0-939a-de7b588d583f\" (UID: \"0ba6f637-cb5c-49a0-939a-de7b588d583f\") "
Jul 23 15:34:04.507922 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.507894    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ba6f637-cb5c-49a0-939a-de7b588d583f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ba6f637-cb5c-49a0-939a-de7b588d583f" (UID: "0ba6f637-cb5c-49a0-939a-de7b588d583f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:34:04.509638 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.509606    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba6f637-cb5c-49a0-939a-de7b588d583f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ba6f637-cb5c-49a0-939a-de7b588d583f" (UID: "0ba6f637-cb5c-49a0-939a-de7b588d583f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:34:04.509767 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.509653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba6f637-cb5c-49a0-939a-de7b588d583f-kube-api-access-4fghz" (OuterVolumeSpecName: "kube-api-access-4fghz") pod "0ba6f637-cb5c-49a0-939a-de7b588d583f" (UID: "0ba6f637-cb5c-49a0-939a-de7b588d583f"). InnerVolumeSpecName "kube-api-access-4fghz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:34:04.608845 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.608816    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fghz\" (UniqueName: \"kubernetes.io/projected/0ba6f637-cb5c-49a0-939a-de7b588d583f-kube-api-access-4fghz\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:34:04.608845 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.608841    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6f637-cb5c-49a0-939a-de7b588d583f-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:34:04.608845 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.608851    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ba6f637-cb5c-49a0-939a-de7b588d583f-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:34:04.877103 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.877014    2575 generic.go:356] "Generic (PLEG): container finished" podID="0ba6f637-cb5c-49a0-939a-de7b588d583f" containerID="2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b" exitCode=0
Jul 23 15:34:04.877103 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.877054    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"
Jul 23 15:34:04.877376 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.877102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv" event={"ID":"0ba6f637-cb5c-49a0-939a-de7b588d583f","Type":"ContainerDied","Data":"2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b"}
Jul 23 15:34:04.877376 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.877159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv" event={"ID":"0ba6f637-cb5c-49a0-939a-de7b588d583f","Type":"ContainerDied","Data":"98382fa1857753e1d0d600e2ba8ef9e5aa08a12e56420d27954b9f2fc8faea4a"}
Jul 23 15:34:04.877376 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.877214    2575 scope.go:117] "RemoveContainer" containerID="2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b"
Jul 23 15:34:04.886433 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.886417    2575 scope.go:117] "RemoveContainer" containerID="2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b"
Jul 23 15:34:04.886664 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:34:04.886643    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b\": container with ID starting with 2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b not found: ID does not exist" containerID="2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b"
Jul 23 15:34:04.886707 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.886672    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b"} err="failed to get container status \"2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b\": rpc error: code = NotFound desc = could not find container \"2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b\": container with ID starting with 2b0c1b290a2c85a880d67e147d0078c1d348b8943e6e3e5f596c672ee6a0893b not found: ID does not exist"
Jul 23 15:34:04.898834 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.898808    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"]
Jul 23 15:34:04.905000 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:04.904978    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9a77be01-78d85488c6-gjblv"]
Jul 23 15:34:05.867209 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:05.867028    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ba6f637-cb5c-49a0-939a-de7b588d583f" path="/var/lib/kubelet/pods/0ba6f637-cb5c-49a0-939a-de7b588d583f/volumes"
Jul 23 15:34:08.912308 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:08.912268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:09.570605 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:09.570557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:15.373998 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:15.373935    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:15.475309 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:15.475275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:15.658422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:15.658329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:15.906121 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:15.906082    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:16.027593 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:16.027559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:16.126763 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:16.126722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:16.261618 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:16.261587    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:22.129254 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:22.129209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:22.231346 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:22.231306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:22.329477 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:22.329438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:22.514905 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:22.514867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:28.508814 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:28.508773    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:28.607786 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:28.607757    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:35.329006 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:35.328968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:35.635046 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:35.634955    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:37.275471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:37.275429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:38.811347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.811179    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"]
Jul 23 15:34:38.811904 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.811881    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba6f637-cb5c-49a0-939a-de7b588d583f" containerName="maas-api"
Jul 23 15:34:38.811994 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.811908    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba6f637-cb5c-49a0-939a-de7b588d583f" containerName="maas-api"
Jul 23 15:34:38.812052 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.812014    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba6f637-cb5c-49a0-939a-de7b588d583f" containerName="maas-api"
Jul 23 15:34:38.815532 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.815510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.818012 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.817993    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cafd77c7-serving-cert\""
Jul 23 15:34:38.826411 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.826384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"]
Jul 23 15:34:38.833214 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.833157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.833338 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.833241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55e96842-c2d5-40ad-9c07-f2546f76c7f4-openshift-service-ca\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.833338 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.833290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9dpd\" (UniqueName: \"kubernetes.io/projected/55e96842-c2d5-40ad-9c07-f2546f76c7f4-kube-api-access-q9dpd\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.934539 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.934506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.934760 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.934557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55e96842-c2d5-40ad-9c07-f2546f76c7f4-openshift-service-ca\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.934760 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.934610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9dpd\" (UniqueName: \"kubernetes.io/projected/55e96842-c2d5-40ad-9c07-f2546f76c7f4-kube-api-access-q9dpd\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.934760 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:34:38.934677    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-serving-cert: secret "maas-api-e2e-mt-cafd77c7-serving-cert" not found
Jul 23 15:34:38.934935 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:34:38.934771    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls podName:55e96842-c2d5-40ad-9c07-f2546f76c7f4 nodeName:}" failed. No retries permitted until 2026-07-23 15:34:39.43474814 +0000 UTC m=+2064.148680071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls") pod "maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c" (UID: "55e96842-c2d5-40ad-9c07-f2546f76c7f4") : secret "maas-api-e2e-mt-cafd77c7-serving-cert" not found
Jul 23 15:34:38.935307 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.935288    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55e96842-c2d5-40ad-9c07-f2546f76c7f4-openshift-service-ca\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:38.946607 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:38.946578    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9dpd\" (UniqueName: \"kubernetes.io/projected/55e96842-c2d5-40ad-9c07-f2546f76c7f4-kube-api-access-q9dpd\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:39.439682 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:39.439643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:39.442306 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:39.442266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls\") pod \"maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:39.728911 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:39.728822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:39.882640 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:39.882600    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"]
Jul 23 15:34:39.886138 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:34:39.886112    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e96842_c2d5_40ad_9c07_f2546f76c7f4.slice/crio-a177b130611575f1cdc44ce70f33ffe3b312ede878d1f949f1df3e46748beba6 WatchSource:0}: Error finding container a177b130611575f1cdc44ce70f33ffe3b312ede878d1f949f1df3e46748beba6: Status 404 returned error can't find the container with id a177b130611575f1cdc44ce70f33ffe3b312ede878d1f949f1df3e46748beba6
Jul 23 15:34:39.887432 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:39.887404    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:34:39.967591 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:39.967549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:40.033744 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:40.033659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:40.052404 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:40.052363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c" event={"ID":"55e96842-c2d5-40ad-9c07-f2546f76c7f4","Type":"ContainerStarted","Data":"a177b130611575f1cdc44ce70f33ffe3b312ede878d1f949f1df3e46748beba6"}
Jul 23 15:34:41.058690 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:41.058643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c" event={"ID":"55e96842-c2d5-40ad-9c07-f2546f76c7f4","Type":"ContainerStarted","Data":"f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6"}
Jul 23 15:34:41.059119 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:41.058845    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:41.078752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:41.078697    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c" podStartSLOduration=2.441563613 podStartE2EDuration="3.078678685s" totalImagesPullingTime="637.115072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:34:41.076749197 +0000 UTC m=+2065.790681166" watchObservedRunningTime="2026-07-23 15:34:41.078678685 +0000 UTC m=+2065.792610622"
Jul 23 15:34:41.555452 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:41.555419    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:43.268303 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:43.268265    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:34:47.069740 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:47.069708    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:34:56.942283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:34:56.942231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:35:32.339525 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.339483    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"]
Jul 23 15:35:32.340070 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.339752    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c" podUID="55e96842-c2d5-40ad-9c07-f2546f76c7f4" containerName="maas-api" containerID="cri-o://f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6" gracePeriod=30
Jul 23 15:35:32.488109 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.488063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:35:32.599871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.599798    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:35:32.653927 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.653895    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55e96842-c2d5-40ad-9c07-f2546f76c7f4-openshift-service-ca\") pod \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") "
Jul 23 15:35:32.654124 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.653939    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls\") pod \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") "
Jul 23 15:35:32.654124 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.654058    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9dpd\" (UniqueName: \"kubernetes.io/projected/55e96842-c2d5-40ad-9c07-f2546f76c7f4-kube-api-access-q9dpd\") pod \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\" (UID: \"55e96842-c2d5-40ad-9c07-f2546f76c7f4\") "
Jul 23 15:35:32.654372 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.654347    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55e96842-c2d5-40ad-9c07-f2546f76c7f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55e96842-c2d5-40ad-9c07-f2546f76c7f4" (UID: "55e96842-c2d5-40ad-9c07-f2546f76c7f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:35:32.656231 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.656207    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55e96842-c2d5-40ad-9c07-f2546f76c7f4" (UID: "55e96842-c2d5-40ad-9c07-f2546f76c7f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:35:32.656307 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.656267    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55e96842-c2d5-40ad-9c07-f2546f76c7f4-kube-api-access-q9dpd" (OuterVolumeSpecName: "kube-api-access-q9dpd") pod "55e96842-c2d5-40ad-9c07-f2546f76c7f4" (UID: "55e96842-c2d5-40ad-9c07-f2546f76c7f4"). InnerVolumeSpecName "kube-api-access-q9dpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:35:32.755830 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.755793    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55e96842-c2d5-40ad-9c07-f2546f76c7f4-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:35:32.755830 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.755823    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9dpd\" (UniqueName: \"kubernetes.io/projected/55e96842-c2d5-40ad-9c07-f2546f76c7f4-kube-api-access-q9dpd\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:35:32.755830 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:32.755834    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55e96842-c2d5-40ad-9c07-f2546f76c7f4-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:35:33.335925 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.335887    2575 generic.go:356] "Generic (PLEG): container finished" podID="55e96842-c2d5-40ad-9c07-f2546f76c7f4" containerID="f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6" exitCode=0
Jul 23 15:35:33.336112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.335934    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"
Jul 23 15:35:33.336112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.335974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c" event={"ID":"55e96842-c2d5-40ad-9c07-f2546f76c7f4","Type":"ContainerDied","Data":"f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6"}
Jul 23 15:35:33.336112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.336029    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c" event={"ID":"55e96842-c2d5-40ad-9c07-f2546f76c7f4","Type":"ContainerDied","Data":"a177b130611575f1cdc44ce70f33ffe3b312ede878d1f949f1df3e46748beba6"}
Jul 23 15:35:33.336112 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.336051    2575 scope.go:117] "RemoveContainer" containerID="f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6"
Jul 23 15:35:33.345831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.345609    2575 scope.go:117] "RemoveContainer" containerID="f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6"
Jul 23 15:35:33.346063 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:35:33.345928    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6\": container with ID starting with f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6 not found: ID does not exist" containerID="f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6"
Jul 23 15:35:33.346063 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.345963    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6"} err="failed to get container status \"f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6\": rpc error: code = NotFound desc = could not find container \"f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6\": container with ID starting with f7fa3ec0336f528c6199075e4e9fa3ae88ac7109b6869f0bbf2cc8d9d338f2d6 not found: ID does not exist"
Jul 23 15:35:33.378836 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.378798    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"]
Jul 23 15:35:33.382343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.382315    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cafd77c7-f7449d8bd-ssp6c"]
Jul 23 15:35:33.866347 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:33.866315    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55e96842-c2d5-40ad-9c07-f2546f76c7f4" path="/var/lib/kubelet/pods/55e96842-c2d5-40ad-9c07-f2546f76c7f4/volumes"
Jul 23 15:35:36.851656 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:36.851616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:35:39.199511 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:39.199473    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:35:44.231031 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:35:44.230996    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:20.563805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:20.563759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:21.387944 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:21.387908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:26.155007 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:26.154966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:26.252610 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:26.252568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:27.235403 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:27.235366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:27.337107 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:27.337060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:27.532348 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:27.532254    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:27.781414 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:27.781380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:28.883646 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:28.883597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:28.983533 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:28.983502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:29.083906 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:29.083869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:29.821764 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:29.821722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:29.921831 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:29.921791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:30.020208 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:30.020146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:31.481357 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:31.481309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:37.752431 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:37.752387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:37.823643 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:37.823611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:38.446113 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:38.446069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:44.434550 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:44.434487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:44.536381 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:44.536348    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:44.635475 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:44.635441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:55.185299 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:55.185266    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:36:57.140738 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:36:57.140695    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:16.557708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:16.557668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:22.828131 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:22.828091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:22.933381 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:22.933351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:23.181892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:23.181854    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:23.511356 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:23.511274    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:23.605048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:23.605002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:26.578611 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.578558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:26.654888 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.654840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:26.656024 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.656004    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"]
Jul 23 15:37:26.656626 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.656603    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e96842-c2d5-40ad-9c07-f2546f76c7f4" containerName="maas-api"
Jul 23 15:37:26.656626 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.656624    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e96842-c2d5-40ad-9c07-f2546f76c7f4" containerName="maas-api"
Jul 23 15:37:26.656785 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.656693    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="55e96842-c2d5-40ad-9c07-f2546f76c7f4" containerName="maas-api"
Jul 23 15:37:26.659543 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.659528    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.662104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.662080    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-80ba32-serving-cert\""
Jul 23 15:37:26.670378 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.670350    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"]
Jul 23 15:37:26.736589 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.736551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:26.739752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.739725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstnt\" (UniqueName: \"kubernetes.io/projected/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-kube-api-access-fstnt\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.739878 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.739800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.739878 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.739826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.841343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.841252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.841343 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.841293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.841551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.841376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstnt\" (UniqueName: \"kubernetes.io/projected/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-kube-api-access-fstnt\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.842043 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.842018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.844156 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.844123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.850232 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.850196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstnt\" (UniqueName: \"kubernetes.io/projected/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-kube-api-access-fstnt\") pod \"maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:26.853546 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.853518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:26.971763 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:26.971719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:27.115021 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:27.114996    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"]
Jul 23 15:37:27.117429 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:37:27.117394    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26feb2f_d47f_4e1d_98a1_8d6bf09f21e9.slice/crio-900dbddd14f188dc5998bb539437f3e5b5a0f87f9f9477f0b5cacb214bb47d4a WatchSource:0}: Error finding container 900dbddd14f188dc5998bb539437f3e5b5a0f87f9f9477f0b5cacb214bb47d4a: Status 404 returned error can't find the container with id 900dbddd14f188dc5998bb539437f3e5b5a0f87f9f9477f0b5cacb214bb47d4a
Jul 23 15:37:27.239421 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:27.239377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:27.339033 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:27.338992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:27.901454 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:27.901420    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8" event={"ID":"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9","Type":"ContainerStarted","Data":"900dbddd14f188dc5998bb539437f3e5b5a0f87f9f9477f0b5cacb214bb47d4a"}
Jul 23 15:37:28.908422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:28.908382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8" event={"ID":"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9","Type":"ContainerStarted","Data":"6bbc1acbb1886f802a1e86b93be7d219700003c015d439abf10c1bc57abdab44"}
Jul 23 15:37:28.908873 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:28.908590    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:28.927948 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:28.927896    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8" podStartSLOduration=1.3022381410000001 podStartE2EDuration="2.927876982s" totalImagesPullingTime="1.625638841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:37:28.926832716 +0000 UTC m=+2233.640764672" watchObservedRunningTime="2026-07-23 15:37:28.927876982 +0000 UTC m=+2233.641808918"
Jul 23 15:37:31.177818 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:31.177777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:31.536437 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:31.536351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:31.813161 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:31.813075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:32.318990 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:32.318926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:34.624075 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.624035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:34.721828 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.721792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:34.809939 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.809906    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"]
Jul 23 15:37:34.813919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.813893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:34.816989 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.816969    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-979b59-serving-cert\""
Jul 23 15:37:34.827528 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.827497    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"]
Jul 23 15:37:34.854832 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.854800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:34.918927 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.918903    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:37:34.922806 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.922777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfhq\" (UniqueName: \"kubernetes.io/projected/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-kube-api-access-txfhq\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:34.922947 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.922812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:34.922947 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:34.922833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-openshift-service-ca\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.024566 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.024523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txfhq\" (UniqueName: \"kubernetes.io/projected/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-kube-api-access-txfhq\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.024566 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.024569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.024847 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.024595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-openshift-service-ca\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.024847 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:37:35.024720    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-serving-cert: secret "maas-api-e2e-inf-b-979b59-serving-cert" not found
Jul 23 15:37:35.024847 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:37:35.024794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls podName:8e4b9c95-088d-4a09-ac6c-70bdc699bf04 nodeName:}" failed. No retries permitted until 2026-07-23 15:37:35.524771807 +0000 UTC m=+2240.238703726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls") pod "maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" (UID: "8e4b9c95-088d-4a09-ac6c-70bdc699bf04") : secret "maas-api-e2e-inf-b-979b59-serving-cert" not found
Jul 23 15:37:35.025253 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.025233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-openshift-service-ca\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.039087 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.039052    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfhq\" (UniqueName: \"kubernetes.io/projected/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-kube-api-access-txfhq\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.269439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.269342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:35.412776 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.412741    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:35.528833 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.528739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.531204 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.531160    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls\") pod \"maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.725664 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.725624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:35.868391 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.868366    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"]
Jul 23 15:37:35.870006 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:37:35.869976    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4b9c95_088d_4a09_ac6c_70bdc699bf04.slice/crio-32c20e1cbecc4d5bf54c1a8a03d9a6f16f8bdae629e064832a4ca74bf2444628 WatchSource:0}: Error finding container 32c20e1cbecc4d5bf54c1a8a03d9a6f16f8bdae629e064832a4ca74bf2444628: Status 404 returned error can't find the container with id 32c20e1cbecc4d5bf54c1a8a03d9a6f16f8bdae629e064832a4ca74bf2444628
Jul 23 15:37:35.946188 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:35.946142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" event={"ID":"8e4b9c95-088d-4a09-ac6c-70bdc699bf04","Type":"ContainerStarted","Data":"32c20e1cbecc4d5bf54c1a8a03d9a6f16f8bdae629e064832a4ca74bf2444628"}
Jul 23 15:37:36.943473 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:36.943422    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:36.952461 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:36.952427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" event={"ID":"8e4b9c95-088d-4a09-ac6c-70bdc699bf04","Type":"ContainerStarted","Data":"dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a"}
Jul 23 15:37:36.952615 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:36.952494    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:36.971152 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:36.971098    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" podStartSLOduration=2.049897018 podStartE2EDuration="2.971081035s" totalImagesPullingTime="921.184017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:37:36.969277734 +0000 UTC m=+2241.683209674" watchObservedRunningTime="2026-07-23 15:37:36.971081035 +0000 UTC m=+2241.685013053"
Jul 23 15:37:40.612599 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:40.612506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:42.964089 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:42.964061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:37:43.426254 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:43.426219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:48.032901 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:48.032869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:48.136213 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:48.136147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:56.995546 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:56.995506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:37:57.097180 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:37:57.097131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:38:02.712087 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:02.712044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:38:43.678500 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:43.678452    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:38:44.596023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:44.595982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:38:45.314257 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:45.314215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:38:45.402081 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:45.402049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:38:55.235292 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.235257    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"]
Jul 23 15:38:55.235822 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.235529    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8" podUID="e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" containerName="maas-api" containerID="cri-o://6bbc1acbb1886f802a1e86b93be7d219700003c015d439abf10c1bc57abdab44" gracePeriod=30
Jul 23 15:38:55.277893 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.277859    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:38:55.353911 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.353882    2575 generic.go:356] "Generic (PLEG): container finished" podID="e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" containerID="6bbc1acbb1886f802a1e86b93be7d219700003c015d439abf10c1bc57abdab44" exitCode=0
Jul 23 15:38:55.354041 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.353920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8" event={"ID":"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9","Type":"ContainerDied","Data":"6bbc1acbb1886f802a1e86b93be7d219700003c015d439abf10c1bc57abdab44"}
Jul 23 15:38:55.489898 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.489837    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:38:55.600102 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.600059    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-openshift-service-ca\") pod \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") "
Jul 23 15:38:55.600301 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.600124    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fstnt\" (UniqueName: \"kubernetes.io/projected/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-kube-api-access-fstnt\") pod \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") "
Jul 23 15:38:55.600301 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.600187    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-maas-api-tls\") pod \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\" (UID: \"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9\") "
Jul 23 15:38:55.600505 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.600414    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" (UID: "e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:38:55.600636 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.600615    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:38:55.602308 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.602284    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" (UID: "e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:38:55.602423 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.602392    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-kube-api-access-fstnt" (OuterVolumeSpecName: "kube-api-access-fstnt") pod "e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" (UID: "e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9"). InnerVolumeSpecName "kube-api-access-fstnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:38:55.702163 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.702125    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fstnt\" (UniqueName: \"kubernetes.io/projected/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-kube-api-access-fstnt\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:38:55.702163 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:55.702155    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:38:56.360637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:56.360607    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"
Jul 23 15:38:56.361102 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:56.360630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8" event={"ID":"e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9","Type":"ContainerDied","Data":"900dbddd14f188dc5998bb539437f3e5b5a0f87f9f9477f0b5cacb214bb47d4a"}
Jul 23 15:38:56.361102 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:56.360699    2575 scope.go:117] "RemoveContainer" containerID="6bbc1acbb1886f802a1e86b93be7d219700003c015d439abf10c1bc57abdab44"
Jul 23 15:38:56.380297 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:56.380271    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"]
Jul 23 15:38:56.384584 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:56.384562    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80ba32-ff795dd8b-vcjq8"]
Jul 23 15:38:57.865917 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:57.865882    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" path="/var/lib/kubelet/pods/e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9/volumes"
Jul 23 15:38:59.797413 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:38:59.797375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:00.251797 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:00.251761    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:04.669707 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:04.669675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:06.601104 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:06.601063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:06.656675 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:06.656642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:06.916450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:06.916417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:07.149044 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:07.149014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:07.895033 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:07.894985    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:07.993631 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:07.993599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:17.718192 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:17.718144    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"]
Jul 23 15:39:17.718679 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:17.718374    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" podUID="8e4b9c95-088d-4a09-ac6c-70bdc699bf04" containerName="maas-api" containerID="cri-o://dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a" gracePeriod=30
Jul 23 15:39:17.747331 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:17.747295    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:17.974778 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:17.974711    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:39:18.013226 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.013192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txfhq\" (UniqueName: \"kubernetes.io/projected/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-kube-api-access-txfhq\") pod \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") "
Jul 23 15:39:18.013417 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.013255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls\") pod \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") "
Jul 23 15:39:18.013417 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.013298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-openshift-service-ca\") pod \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\" (UID: \"8e4b9c95-088d-4a09-ac6c-70bdc699bf04\") "
Jul 23 15:39:18.013752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.013715    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e4b9c95-088d-4a09-ac6c-70bdc699bf04" (UID: "8e4b9c95-088d-4a09-ac6c-70bdc699bf04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:39:18.015474 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.015442    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e4b9c95-088d-4a09-ac6c-70bdc699bf04" (UID: "8e4b9c95-088d-4a09-ac6c-70bdc699bf04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:39:18.015609 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.015530    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-kube-api-access-txfhq" (OuterVolumeSpecName: "kube-api-access-txfhq") pod "8e4b9c95-088d-4a09-ac6c-70bdc699bf04" (UID: "8e4b9c95-088d-4a09-ac6c-70bdc699bf04"). InnerVolumeSpecName "kube-api-access-txfhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:39:18.115087 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.115047    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txfhq\" (UniqueName: \"kubernetes.io/projected/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-kube-api-access-txfhq\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:39:18.115087 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.115079    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:39:18.115087 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.115090    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e4b9c95-088d-4a09-ac6c-70bdc699bf04-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:39:18.472712 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.472682    2575 generic.go:356] "Generic (PLEG): container finished" podID="8e4b9c95-088d-4a09-ac6c-70bdc699bf04" containerID="dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a" exitCode=0
Jul 23 15:39:18.472897 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.472724    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"
Jul 23 15:39:18.472897 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.472767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" event={"ID":"8e4b9c95-088d-4a09-ac6c-70bdc699bf04","Type":"ContainerDied","Data":"dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a"}
Jul 23 15:39:18.472897 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.472813    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" event={"ID":"8e4b9c95-088d-4a09-ac6c-70bdc699bf04","Type":"ContainerDied","Data":"32c20e1cbecc4d5bf54c1a8a03d9a6f16f8bdae629e064832a4ca74bf2444628"}
Jul 23 15:39:18.472897 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.472837    2575 scope.go:117] "RemoveContainer" containerID="dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a"
Jul 23 15:39:18.481636 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.481618    2575 scope.go:117] "RemoveContainer" containerID="dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a"
Jul 23 15:39:18.481898 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:39:18.481877    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a\": container with ID starting with dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a not found: ID does not exist" containerID="dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a"
Jul 23 15:39:18.481995 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.481904    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a"} err="failed to get container status \"dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a\": rpc error: code = NotFound desc = could not find container \"dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a\": container with ID starting with dcce030ca0705a75b3193a5b3ff5ee262d31e12c63333914f4a112bfe697b45a not found: ID does not exist"
Jul 23 15:39:18.494445 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.494411    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"]
Jul 23 15:39:18.498456 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:18.498433    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4"]
Jul 23 15:39:19.867222 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:19.866565    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e4b9c95-088d-4a09-ac6c-70bdc699bf04" path="/var/lib/kubelet/pods/8e4b9c95-088d-4a09-ac6c-70bdc699bf04/volumes"
Jul 23 15:39:20.958837 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:20.958776    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-979b59-b544d4b56-z9kd4" podUID="8e4b9c95-088d-4a09-ac6c-70bdc699bf04" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.57:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 23 15:39:22.344615 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:22.344578    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:22.758278 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:22.758234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:29.093961 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:29.093917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:30.059934 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:30.059901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:30.159554 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:30.159519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:30.292586 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:30.292549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:30.531257 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:30.531219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:33.190701 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.190648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:33.274918 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.274881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:33.280285 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.280257    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"]
Jul 23 15:39:33.280698 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.280684    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4b9c95-088d-4a09-ac6c-70bdc699bf04" containerName="maas-api"
Jul 23 15:39:33.280698 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.280698    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4b9c95-088d-4a09-ac6c-70bdc699bf04" containerName="maas-api"
Jul 23 15:39:33.280850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.280724    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" containerName="maas-api"
Jul 23 15:39:33.280850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.280731    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" containerName="maas-api"
Jul 23 15:39:33.280850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.280800    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e26feb2f-d47f-4e1d-98a1-8d6bf09f21e9" containerName="maas-api"
Jul 23 15:39:33.280850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.280812    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e4b9c95-088d-4a09-ac6c-70bdc699bf04" containerName="maas-api"
Jul 23 15:39:33.284100 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.284079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.287062 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.287044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2a5003-serving-cert\""
Jul 23 15:39:33.296789 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.296765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"]
Jul 23 15:39:33.336973 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.336936    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:33.351575 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.351542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslj9\" (UniqueName: \"kubernetes.io/projected/15e51c4b-1a9b-4822-874f-3a12d1fd8055-kube-api-access-tslj9\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.351758 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.351621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.351758 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.351671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e51c4b-1a9b-4822-874f-3a12d1fd8055-openshift-service-ca\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.452810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.452721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.452810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.452782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e51c4b-1a9b-4822-874f-3a12d1fd8055-openshift-service-ca\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.453002 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.452848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tslj9\" (UniqueName: \"kubernetes.io/projected/15e51c4b-1a9b-4822-874f-3a12d1fd8055-kube-api-access-tslj9\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.453002 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:39:33.452882    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-serving-cert: secret "maas-api-e2e-api-a-2a5003-serving-cert" not found
Jul 23 15:39:33.453002 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:39:33.452962    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls podName:15e51c4b-1a9b-4822-874f-3a12d1fd8055 nodeName:}" failed. No retries permitted until 2026-07-23 15:39:33.952939277 +0000 UTC m=+2358.666871197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls") pod "maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b" (UID: "15e51c4b-1a9b-4822-874f-3a12d1fd8055") : secret "maas-api-e2e-api-a-2a5003-serving-cert" not found
Jul 23 15:39:33.453517 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.453496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e51c4b-1a9b-4822-874f-3a12d1fd8055-openshift-service-ca\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.462745 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.462714    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslj9\" (UniqueName: \"kubernetes.io/projected/15e51c4b-1a9b-4822-874f-3a12d1fd8055-kube-api-access-tslj9\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.655921 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.655886    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:33.953823 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.953791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:33.957964 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.957939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:33.960739 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:33.960716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls\") pod \"maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:34.053692 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:34.053660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:34.194313 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:34.194270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:34.343793 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:34.343766    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"]
Jul 23 15:39:34.346599 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:39:34.346567    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e51c4b_1a9b_4822_874f_3a12d1fd8055.slice/crio-e74aff1e3c94c68fab28345b41bd55dea7ac2e70c8ec30f39b99134fd1457070 WatchSource:0}: Error finding container e74aff1e3c94c68fab28345b41bd55dea7ac2e70c8ec30f39b99134fd1457070: Status 404 returned error can't find the container with id e74aff1e3c94c68fab28345b41bd55dea7ac2e70c8ec30f39b99134fd1457070
Jul 23 15:39:34.555790 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:34.555706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b" event={"ID":"15e51c4b-1a9b-4822-874f-3a12d1fd8055","Type":"ContainerStarted","Data":"e74aff1e3c94c68fab28345b41bd55dea7ac2e70c8ec30f39b99134fd1457070"}
Jul 23 15:39:35.562101 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:35.562063    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b" event={"ID":"15e51c4b-1a9b-4822-874f-3a12d1fd8055","Type":"ContainerStarted","Data":"f227907dae18e336ef6de86ad38f9be0ac8e796b404fdb9e82d0eb8b8253966b"}
Jul 23 15:39:35.562607 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:35.562211    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:35.600562 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:35.600499    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b" podStartSLOduration=2.18139079 podStartE2EDuration="2.600478666s" totalImagesPullingTime="419.087876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:39:35.593324413 +0000 UTC m=+2360.307256350" watchObservedRunningTime="2026-07-23 15:39:35.600478666 +0000 UTC m=+2360.314410606"
Jul 23 15:39:37.719987 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:37.719929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:38.207454 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:38.207411    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:38.536482 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:38.536389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:38.661514 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:38.661473    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:41.199940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.199905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:41.412626 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.412592    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"]
Jul 23 15:39:41.416966 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.416946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.419574 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.419551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2b4d9c-serving-cert\""
Jul 23 15:39:41.425434 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.425410    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"]
Jul 23 15:39:41.529736 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.529639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940837b6-3004-4f3a-96a9-3860c0ad92c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.529736 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.529727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.529963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.529765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td69m\" (UniqueName: \"kubernetes.io/projected/940837b6-3004-4f3a-96a9-3860c0ad92c7-kube-api-access-td69m\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.573790 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.573763    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:39:41.631082 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.631048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940837b6-3004-4f3a-96a9-3860c0ad92c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.631281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.631135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.631281 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.631164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td69m\" (UniqueName: \"kubernetes.io/projected/940837b6-3004-4f3a-96a9-3860c0ad92c7-kube-api-access-td69m\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.631405 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:39:41.631310    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-serving-cert: secret "maas-api-e2e-api-b-2b4d9c-serving-cert" not found
Jul 23 15:39:41.631405 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:39:41.631385    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls podName:940837b6-3004-4f3a-96a9-3860c0ad92c7 nodeName:}" failed. No retries permitted until 2026-07-23 15:39:42.131360943 +0000 UTC m=+2366.845292857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls") pod "maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s" (UID: "940837b6-3004-4f3a-96a9-3860c0ad92c7") : secret "maas-api-e2e-api-b-2b4d9c-serving-cert" not found
Jul 23 15:39:41.631780 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.631759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940837b6-3004-4f3a-96a9-3860c0ad92c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:41.640334 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:41.640306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td69m\" (UniqueName: \"kubernetes.io/projected/940837b6-3004-4f3a-96a9-3860c0ad92c7-kube-api-access-td69m\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:42.137445 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.137396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:42.140286 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.140247    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls\") pod \"maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:42.329467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.329432    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:42.473410 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.473375    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"]
Jul 23 15:39:42.479862 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.479829    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:39:42.542794 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.542757    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:42.597922 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.597885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s" event={"ID":"940837b6-3004-4f3a-96a9-3860c0ad92c7","Type":"ContainerStarted","Data":"31f734bac66ad215252a84522ce17b2666ecbd6b7acf5bbeb642714654099a0c"}
Jul 23 15:39:42.642779 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:42.642725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:43.604055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:43.604011    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s" event={"ID":"940837b6-3004-4f3a-96a9-3860c0ad92c7","Type":"ContainerStarted","Data":"dee73fbfcf4fb6dd7413f64cb116d10cd603b8e907f137178c9715070e417144"}
Jul 23 15:39:43.604491 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:43.604135    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:43.646099 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:43.646043    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s" podStartSLOduration=2.142828843 podStartE2EDuration="2.646025155s" totalImagesPullingTime="503.196312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:39:43.6442134 +0000 UTC m=+2368.358145356" watchObservedRunningTime="2026-07-23 15:39:43.646025155 +0000 UTC m=+2368.359957092"
Jul 23 15:39:45.748130 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:45.748078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:49.614209 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:49.614162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:39:54.363020 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:54.362980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:39:54.462928 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:39:54.462893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:02.795758 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:02.795695    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:02.888954 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:02.888919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:04.391718 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:04.391685    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:04.489190 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:04.489123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:09.614044 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:09.614013    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"]
Jul 23 15:40:09.614851 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:09.614797    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b" podUID="15e51c4b-1a9b-4822-874f-3a12d1fd8055" containerName="maas-api" containerID="cri-o://f227907dae18e336ef6de86ad38f9be0ac8e796b404fdb9e82d0eb8b8253966b" gracePeriod=30
Jul 23 15:40:09.644894 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:09.644852    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:09.739392 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:09.739357    2575 generic.go:356] "Generic (PLEG): container finished" podID="15e51c4b-1a9b-4822-874f-3a12d1fd8055" containerID="f227907dae18e336ef6de86ad38f9be0ac8e796b404fdb9e82d0eb8b8253966b" exitCode=0
Jul 23 15:40:09.739545 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:09.739433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b" event={"ID":"15e51c4b-1a9b-4822-874f-3a12d1fd8055","Type":"ContainerDied","Data":"f227907dae18e336ef6de86ad38f9be0ac8e796b404fdb9e82d0eb8b8253966b"}
Jul 23 15:40:09.881606 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:09.881578    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:40:10.010944 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.010898    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls\") pod \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") "
Jul 23 15:40:10.011124 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.010958    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e51c4b-1a9b-4822-874f-3a12d1fd8055-openshift-service-ca\") pod \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") "
Jul 23 15:40:10.011124 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.011002    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tslj9\" (UniqueName: \"kubernetes.io/projected/15e51c4b-1a9b-4822-874f-3a12d1fd8055-kube-api-access-tslj9\") pod \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\" (UID: \"15e51c4b-1a9b-4822-874f-3a12d1fd8055\") "
Jul 23 15:40:10.011413 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.011387    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51c4b-1a9b-4822-874f-3a12d1fd8055-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15e51c4b-1a9b-4822-874f-3a12d1fd8055" (UID: "15e51c4b-1a9b-4822-874f-3a12d1fd8055"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:40:10.013220 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.013196    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15e51c4b-1a9b-4822-874f-3a12d1fd8055" (UID: "15e51c4b-1a9b-4822-874f-3a12d1fd8055"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:40:10.013220 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.013207    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e51c4b-1a9b-4822-874f-3a12d1fd8055-kube-api-access-tslj9" (OuterVolumeSpecName: "kube-api-access-tslj9") pod "15e51c4b-1a9b-4822-874f-3a12d1fd8055" (UID: "15e51c4b-1a9b-4822-874f-3a12d1fd8055"). InnerVolumeSpecName "kube-api-access-tslj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:40:10.112694 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.112658    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e51c4b-1a9b-4822-874f-3a12d1fd8055-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:40:10.112694 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.112688    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e51c4b-1a9b-4822-874f-3a12d1fd8055-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:40:10.112694 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.112698    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tslj9\" (UniqueName: \"kubernetes.io/projected/15e51c4b-1a9b-4822-874f-3a12d1fd8055-kube-api-access-tslj9\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:40:10.746192 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.746136    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b" event={"ID":"15e51c4b-1a9b-4822-874f-3a12d1fd8055","Type":"ContainerDied","Data":"e74aff1e3c94c68fab28345b41bd55dea7ac2e70c8ec30f39b99134fd1457070"}
Jul 23 15:40:10.746645 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.746217    2575 scope.go:117] "RemoveContainer" containerID="f227907dae18e336ef6de86ad38f9be0ac8e796b404fdb9e82d0eb8b8253966b"
Jul 23 15:40:10.746645 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.746143    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"
Jul 23 15:40:10.770436 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.770408    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"]
Jul 23 15:40:10.774349 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:10.774325    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2a5003-5ffc4bb45d-gxl8b"]
Jul 23 15:40:11.724062 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:11.724022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:11.866132 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:11.866092    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e51c4b-1a9b-4822-874f-3a12d1fd8055" path="/var/lib/kubelet/pods/15e51c4b-1a9b-4822-874f-3a12d1fd8055/volumes"
Jul 23 15:40:13.918644 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:13.918595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:14.319915 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:14.319814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:20.695979 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:20.695948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:20.796634 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:20.796583    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:20.980214 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:20.980096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:21.206737 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.206699    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:21.337779 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.337698    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"]
Jul 23 15:40:21.338330 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.338313    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51c4b-1a9b-4822-874f-3a12d1fd8055" containerName="maas-api"
Jul 23 15:40:21.338389 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.338332    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51c4b-1a9b-4822-874f-3a12d1fd8055" containerName="maas-api"
Jul 23 15:40:21.338425 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.338403    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e51c4b-1a9b-4822-874f-3a12d1fd8055" containerName="maas-api"
Jul 23 15:40:21.343028 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.343005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"
Jul 23 15:40:21.345973 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.345947    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:40:21.348684 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.348654    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"]
Jul 23 15:40:21.424669 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.424617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2757ec8-5d4a-4339-9090-097559d7fe3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb\" (UID: \"b2757ec8-5d4a-4339-9090-097559d7fe3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"
Jul 23 15:40:21.526246 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.526209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2757ec8-5d4a-4339-9090-097559d7fe3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb\" (UID: \"b2757ec8-5d4a-4339-9090-097559d7fe3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"
Jul 23 15:40:21.526837 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.526818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2757ec8-5d4a-4339-9090-097559d7fe3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb\" (UID: \"b2757ec8-5d4a-4339-9090-097559d7fe3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"
Jul 23 15:40:21.657538 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.657455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"
Jul 23 15:40:21.797219 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.797195    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"]
Jul 23 15:40:21.799294 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:40:21.799262    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2757ec8_5d4a_4339_9090_097559d7fe3e.slice/crio-b12f337134b7b09d20ae9ecf54eba271dbc21ac5a51b3b9256cc399251502460 WatchSource:0}: Error finding container b12f337134b7b09d20ae9ecf54eba271dbc21ac5a51b3b9256cc399251502460: Status 404 returned error can't find the container with id b12f337134b7b09d20ae9ecf54eba271dbc21ac5a51b3b9256cc399251502460
Jul 23 15:40:21.806688 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.806655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb" event={"ID":"b2757ec8-5d4a-4339-9090-097559d7fe3e","Type":"ContainerStarted","Data":"b12f337134b7b09d20ae9ecf54eba271dbc21ac5a51b3b9256cc399251502460"}
Jul 23 15:40:21.967709 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:21.967657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:22.067476 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:22.067438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:24.822426 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:24.822329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb" event={"ID":"b2757ec8-5d4a-4339-9090-097559d7fe3e","Type":"ContainerStarted","Data":"f2667ef2227cfd45c8ff780f704a5cda3e6006984579b3eab98718a08c8f090a"}
Jul 23 15:40:24.843612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:24.843550    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb" podStartSLOduration=1.48783989 podStartE2EDuration="3.843529759s" totalImagesPullingTime="2.355689869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:40:24.841317849 +0000 UTC m=+2409.555249805" watchObservedRunningTime="2026-07-23 15:40:24.843529759 +0000 UTC m=+2409.557461697"
Jul 23 15:40:25.829595 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:25.829559    2575 generic.go:356] "Generic (PLEG): container finished" podID="b2757ec8-5d4a-4339-9090-097559d7fe3e" containerID="f2667ef2227cfd45c8ff780f704a5cda3e6006984579b3eab98718a08c8f090a" exitCode=0
Jul 23 15:40:25.830019 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:25.829622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb" event={"ID":"b2757ec8-5d4a-4339-9090-097559d7fe3e","Type":"ContainerDied","Data":"f2667ef2227cfd45c8ff780f704a5cda3e6006984579b3eab98718a08c8f090a"}
Jul 23 15:40:26.976365 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:26.976337    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"
Jul 23 15:40:27.081285 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:27.081248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2757ec8-5d4a-4339-9090-097559d7fe3e-maas-api-service-ca\") pod \"b2757ec8-5d4a-4339-9090-097559d7fe3e\" (UID: \"b2757ec8-5d4a-4339-9090-097559d7fe3e\") "
Jul 23 15:40:27.081659 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:27.081634    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2757ec8-5d4a-4339-9090-097559d7fe3e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b2757ec8-5d4a-4339-9090-097559d7fe3e" (UID: "b2757ec8-5d4a-4339-9090-097559d7fe3e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:40:27.183006 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:27.182971    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2757ec8-5d4a-4339-9090-097559d7fe3e-maas-api-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:40:27.840594 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:27.840565    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"
Jul 23 15:40:27.840773 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:27.840598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb" event={"ID":"b2757ec8-5d4a-4339-9090-097559d7fe3e","Type":"ContainerDied","Data":"b12f337134b7b09d20ae9ecf54eba271dbc21ac5a51b3b9256cc399251502460"}
Jul 23 15:40:27.840773 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:27.840643    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b12f337134b7b09d20ae9ecf54eba271dbc21ac5a51b3b9256cc399251502460"
Jul 23 15:40:27.982509 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:27.982465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:28.082263 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:28.082208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:36.763647 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:36.763608    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"]
Jul 23 15:40:36.764275 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:36.763839    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s" podUID="940837b6-3004-4f3a-96a9-3860c0ad92c7" containerName="maas-api" containerID="cri-o://dee73fbfcf4fb6dd7413f64cb116d10cd603b8e907f137178c9715070e417144" gracePeriod=30
Jul 23 15:40:36.823876 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:36.823839    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:36.887730 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:36.887696    2575 generic.go:356] "Generic (PLEG): container finished" podID="940837b6-3004-4f3a-96a9-3860c0ad92c7" containerID="dee73fbfcf4fb6dd7413f64cb116d10cd603b8e907f137178c9715070e417144" exitCode=0
Jul 23 15:40:36.887891 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:36.887767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s" event={"ID":"940837b6-3004-4f3a-96a9-3860c0ad92c7","Type":"ContainerDied","Data":"dee73fbfcf4fb6dd7413f64cb116d10cd603b8e907f137178c9715070e417144"}
Jul 23 15:40:37.026293 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.026226    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:40:37.072132 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.072104    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940837b6-3004-4f3a-96a9-3860c0ad92c7-openshift-service-ca\") pod \"940837b6-3004-4f3a-96a9-3860c0ad92c7\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") "
Jul 23 15:40:37.072320 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.072281    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls\") pod \"940837b6-3004-4f3a-96a9-3860c0ad92c7\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") "
Jul 23 15:40:37.072364 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.072320    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td69m\" (UniqueName: \"kubernetes.io/projected/940837b6-3004-4f3a-96a9-3860c0ad92c7-kube-api-access-td69m\") pod \"940837b6-3004-4f3a-96a9-3860c0ad92c7\" (UID: \"940837b6-3004-4f3a-96a9-3860c0ad92c7\") "
Jul 23 15:40:37.072564 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.072543    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/940837b6-3004-4f3a-96a9-3860c0ad92c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "940837b6-3004-4f3a-96a9-3860c0ad92c7" (UID: "940837b6-3004-4f3a-96a9-3860c0ad92c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:40:37.072629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.072616    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940837b6-3004-4f3a-96a9-3860c0ad92c7-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:40:37.074537 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.074503    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/940837b6-3004-4f3a-96a9-3860c0ad92c7-kube-api-access-td69m" (OuterVolumeSpecName: "kube-api-access-td69m") pod "940837b6-3004-4f3a-96a9-3860c0ad92c7" (UID: "940837b6-3004-4f3a-96a9-3860c0ad92c7"). InnerVolumeSpecName "kube-api-access-td69m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:40:37.074537 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.074507    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "940837b6-3004-4f3a-96a9-3860c0ad92c7" (UID: "940837b6-3004-4f3a-96a9-3860c0ad92c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:40:37.173119 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.173078    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td69m\" (UniqueName: \"kubernetes.io/projected/940837b6-3004-4f3a-96a9-3860c0ad92c7-kube-api-access-td69m\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:40:37.173119 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.173110    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940837b6-3004-4f3a-96a9-3860c0ad92c7-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:40:37.893703 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.893676    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"
Jul 23 15:40:37.894122 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.893675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s" event={"ID":"940837b6-3004-4f3a-96a9-3860c0ad92c7","Type":"ContainerDied","Data":"31f734bac66ad215252a84522ce17b2666ecbd6b7acf5bbeb642714654099a0c"}
Jul 23 15:40:37.894122 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.893811    2575 scope.go:117] "RemoveContainer" containerID="dee73fbfcf4fb6dd7413f64cb116d10cd603b8e907f137178c9715070e417144"
Jul 23 15:40:37.922161 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.922124    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"]
Jul 23 15:40:37.927231 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:37.927201    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2b4d9c-cf549ccd8-52n6s"]
Jul 23 15:40:39.867056 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:39.867020    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="940837b6-3004-4f3a-96a9-3860c0ad92c7" path="/var/lib/kubelet/pods/940837b6-3004-4f3a-96a9-3860c0ad92c7/volumes"
Jul 23 15:40:41.418975 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:41.418930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:41.419913 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:41.419882    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"]
Jul 23 15:40:41.422023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:41.422001    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2b4d9c-nx7qb"]
Jul 23 15:40:41.822461 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:41.822378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:41.866341 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:41.866306    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2757ec8-5d4a-4339-9090-097559d7fe3e" path="/var/lib/kubelet/pods/b2757ec8-5d4a-4339-9090-097559d7fe3e/volumes"
Jul 23 15:40:48.130483 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:48.130443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:48.230725 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:48.230691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:48.409740 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:48.409645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:48.655632 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:48.655592    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:48.996651 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:48.996614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:49.322876 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:49.322842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:49.660398 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:49.660306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:52.552195 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.552140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:52.632578 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.632548    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"]
Jul 23 15:40:52.633015 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.632997    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2757ec8-5d4a-4339-9090-097559d7fe3e" containerName="revoke-keys"
Jul 23 15:40:52.633015 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.633015    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2757ec8-5d4a-4339-9090-097559d7fe3e" containerName="revoke-keys"
Jul 23 15:40:52.633231 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.633044    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940837b6-3004-4f3a-96a9-3860c0ad92c7" containerName="maas-api"
Jul 23 15:40:52.633231 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.633051    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="940837b6-3004-4f3a-96a9-3860c0ad92c7" containerName="maas-api"
Jul 23 15:40:52.633231 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.633152    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2757ec8-5d4a-4339-9090-097559d7fe3e" containerName="revoke-keys"
Jul 23 15:40:52.633231 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.633181    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="940837b6-3004-4f3a-96a9-3860c0ad92c7" containerName="maas-api"
Jul 23 15:40:52.636369 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.636351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.639232 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.639206    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-290c54-serving-cert\""
Jul 23 15:40:52.646783 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.646756    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"]
Jul 23 15:40:52.715409 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.715369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af4d440-077b-4255-af4b-7f4938cda8d1-maas-api-tls\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.715612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.715456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af4d440-077b-4255-af4b-7f4938cda8d1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.715612 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.715488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrrxs\" (UniqueName: \"kubernetes.io/projected/8af4d440-077b-4255-af4b-7f4938cda8d1-kube-api-access-vrrxs\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.816693 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.816587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af4d440-077b-4255-af4b-7f4938cda8d1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.816693 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.816645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrrxs\" (UniqueName: \"kubernetes.io/projected/8af4d440-077b-4255-af4b-7f4938cda8d1-kube-api-access-vrrxs\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.816946 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.816780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af4d440-077b-4255-af4b-7f4938cda8d1-maas-api-tls\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.817377 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.817353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af4d440-077b-4255-af4b-7f4938cda8d1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.819153 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.819133    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af4d440-077b-4255-af4b-7f4938cda8d1-maas-api-tls\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.825853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.825826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrrxs\" (UniqueName: \"kubernetes.io/projected/8af4d440-077b-4255-af4b-7f4938cda8d1-kube-api-access-vrrxs\") pod \"maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:52.947370 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:52.947334    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:53.094653 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:53.094626    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"]
Jul 23 15:40:53.097030 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:40:53.096999    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af4d440_077b_4255_af4b_7f4938cda8d1.slice/crio-4d6221599fa9acce0a20006512c6664542445fcc19fc5673ea1f9ad38386cbcc WatchSource:0}: Error finding container 4d6221599fa9acce0a20006512c6664542445fcc19fc5673ea1f9ad38386cbcc: Status 404 returned error can't find the container with id 4d6221599fa9acce0a20006512c6664542445fcc19fc5673ea1f9ad38386cbcc
Jul 23 15:40:53.479426 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:53.479379    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:53.575948 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:53.575911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:53.980892 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:53.980860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd" event={"ID":"8af4d440-077b-4255-af4b-7f4938cda8d1","Type":"ContainerStarted","Data":"4d6221599fa9acce0a20006512c6664542445fcc19fc5673ea1f9ad38386cbcc"}
Jul 23 15:40:56.997878 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:56.997837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd" event={"ID":"8af4d440-077b-4255-af4b-7f4938cda8d1","Type":"ContainerStarted","Data":"6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68"}
Jul 23 15:40:56.998299 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:56.997925    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:40:57.017463 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:57.017412    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd" podStartSLOduration=1.912406463 podStartE2EDuration="5.017393778s" totalImagesPullingTime="3.104987315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:40:57.016049456 +0000 UTC m=+2441.729981413" watchObservedRunningTime="2026-07-23 15:40:57.017393778 +0000 UTC m=+2441.731325715"
Jul 23 15:40:57.103135 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:57.103093    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:57.437045 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:57.436986    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:58.438879 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:58.438835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:40:58.538613 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:40:58.538576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:00.650055 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.650014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:00.748636 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.748598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:00.831577 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.831542    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"]
Jul 23 15:41:00.840106 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.840069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:00.842808 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.842784    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d05e2c-serving-cert\""
Jul 23 15:41:00.846857 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.846820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"]
Jul 23 15:41:00.914930 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.914901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:00.997228 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.997161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51e343-b80c-4bc2-b412-a3c60b6e5453-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:00.997415 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.997255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:00.997415 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:00.997276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfphs\" (UniqueName: \"kubernetes.io/projected/9a51e343-b80c-4bc2-b412-a3c60b6e5453-kube-api-access-wfphs\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.098134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.098097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51e343-b80c-4bc2-b412-a3c60b6e5453-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.098134 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.098139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.098424 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.098190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfphs\" (UniqueName: \"kubernetes.io/projected/9a51e343-b80c-4bc2-b412-a3c60b6e5453-kube-api-access-wfphs\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.098424 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:41:01.098304    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-serving-cert: secret "maas-api-e2e-shared-b-d05e2c-serving-cert" not found
Jul 23 15:41:01.098424 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:41:01.098398    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls podName:9a51e343-b80c-4bc2-b412-a3c60b6e5453 nodeName:}" failed. No retries permitted until 2026-07-23 15:41:01.598375021 +0000 UTC m=+2446.312306939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls") pod "maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s" (UID: "9a51e343-b80c-4bc2-b412-a3c60b6e5453") : secret "maas-api-e2e-shared-b-d05e2c-serving-cert" not found
Jul 23 15:41:01.098817 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.098798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51e343-b80c-4bc2-b412-a3c60b6e5453-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.108615 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.108585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfphs\" (UniqueName: \"kubernetes.io/projected/9a51e343-b80c-4bc2-b412-a3c60b6e5453-kube-api-access-wfphs\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.203221 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.203110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:01.377795 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.377752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:01.477450 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.477356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:01.603224 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.603147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.605762 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.605726    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls\") pod \"maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.753414 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.753330    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:01.898692 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:01.898667    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"]
Jul 23 15:41:01.900989 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:41:01.900953    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a51e343_b80c_4bc2_b412_a3c60b6e5453.slice/crio-6cc47cf5a0681bcd39c00d608636ecaf42da7c0b1541a19eed25a04f3efd561e WatchSource:0}: Error finding container 6cc47cf5a0681bcd39c00d608636ecaf42da7c0b1541a19eed25a04f3efd561e: Status 404 returned error can't find the container with id 6cc47cf5a0681bcd39c00d608636ecaf42da7c0b1541a19eed25a04f3efd561e
Jul 23 15:41:02.028638 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:02.028543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s" event={"ID":"9a51e343-b80c-4bc2-b412-a3c60b6e5453","Type":"ContainerStarted","Data":"6cc47cf5a0681bcd39c00d608636ecaf42da7c0b1541a19eed25a04f3efd561e"}
Jul 23 15:41:03.012477 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:03.012440    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:41:05.047099 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:05.047056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s" event={"ID":"9a51e343-b80c-4bc2-b412-a3c60b6e5453","Type":"ContainerStarted","Data":"3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c"}
Jul 23 15:41:05.047624 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:05.047485    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:05.068886 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:05.068840    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s" podStartSLOduration=2.6038264939999998 podStartE2EDuration="5.068826146s" totalImagesPullingTime="2.464999652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:41:05.066881801 +0000 UTC m=+2449.780813739" watchObservedRunningTime="2026-07-23 15:41:05.068826146 +0000 UTC m=+2449.782758082"
Jul 23 15:41:05.180786 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:05.180749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:11.058964 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:11.058932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:41:15.008138 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:15.008095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:15.106240 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:15.106196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:19.920554 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:19.920514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:22.146910 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:22.146870    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:22.247473 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:22.247433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:26.922697 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:26.922656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:27.065235 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:27.065199    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:41:54.377386 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:41:54.377341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:42:54.085400 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:42:54.085369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:42:56.213559 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:42:56.213524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:43:22.016655 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:43:22.016616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:44:07.857050 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:44:07.857015    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:44:08.722005 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:44:08.721973    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:44:17.414768 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:44:17.414731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:45:00.144882 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.144842    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd"]
Jul 23 15:45:00.148786 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.148764    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"]
Jul 23 15:45:00.148916 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.148900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd"
Jul 23 15:45:00.151777 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.151754    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:45:00.152118 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.152098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"
Jul 23 15:45:00.157983 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.157958    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd"]
Jul 23 15:45:00.161514 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.161487    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"]
Jul 23 15:45:00.164410 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.164390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd"
Jul 23 15:45:00.172403 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.172381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"
Jul 23 15:45:00.343125 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.343098    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"]
Jul 23 15:45:00.345359 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:45:00.345320    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f154a5a_38e7_499a_b7b9_d7aa6f217055.slice/crio-d75a4b83fb98356227f5ae94ccbbc838b520d1b271918a13bb019cd872163efe WatchSource:0}: Error finding container d75a4b83fb98356227f5ae94ccbbc838b520d1b271918a13bb019cd872163efe: Status 404 returned error can't find the container with id d75a4b83fb98356227f5ae94ccbbc838b520d1b271918a13bb019cd872163efe
Jul 23 15:45:00.518890 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:00.518863    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd"]
Jul 23 15:45:00.521304 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:45:00.521281    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178c2466_6d9a_4662_95b2_35c601a6c980.slice/crio-f45d00897711e6a80b194b38b2286314a360d5b0d986d41ebd27427da07d113d WatchSource:0}: Error finding container f45d00897711e6a80b194b38b2286314a360d5b0d986d41ebd27427da07d113d: Status 404 returned error can't find the container with id f45d00897711e6a80b194b38b2286314a360d5b0d986d41ebd27427da07d113d
Jul 23 15:45:01.257616 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:01.257580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw" event={"ID":"0f154a5a-38e7-499a-b7b9-d7aa6f217055","Type":"ContainerStarted","Data":"83d5783518d649080662cc7220592ea9b477277f39866228724fd78d9f60edb6"}
Jul 23 15:45:01.258050 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:01.257642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw" event={"ID":"0f154a5a-38e7-499a-b7b9-d7aa6f217055","Type":"ContainerStarted","Data":"d75a4b83fb98356227f5ae94ccbbc838b520d1b271918a13bb019cd872163efe"}
Jul 23 15:45:01.259093 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:01.259065    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd" event={"ID":"178c2466-6d9a-4662-95b2-35c601a6c980","Type":"ContainerStarted","Data":"10476e681924b48a22a07cbc1552a27d2b9d726e0efdd44e1a877e866c9a9d4f"}
Jul 23 15:45:01.259220 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:01.259118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd" event={"ID":"178c2466-6d9a-4662-95b2-35c601a6c980","Type":"ContainerStarted","Data":"f45d00897711e6a80b194b38b2286314a360d5b0d986d41ebd27427da07d113d"}
Jul 23 15:45:01.274936 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:01.274886    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw" podStartSLOduration=1.274869727 podStartE2EDuration="1.274869727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:45:01.273845408 +0000 UTC m=+2685.987777346" watchObservedRunningTime="2026-07-23 15:45:01.274869727 +0000 UTC m=+2685.988801661"
Jul 23 15:45:01.292650 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:01.292604    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd" podStartSLOduration=1.292586227 podStartE2EDuration="1.292586227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:45:01.29097057 +0000 UTC m=+2686.004902546" watchObservedRunningTime="2026-07-23 15:45:01.292586227 +0000 UTC m=+2686.006518164"
Jul 23 15:45:02.265894 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:02.265860    2575 generic.go:356] "Generic (PLEG): container finished" podID="178c2466-6d9a-4662-95b2-35c601a6c980" containerID="10476e681924b48a22a07cbc1552a27d2b9d726e0efdd44e1a877e866c9a9d4f" exitCode=0
Jul 23 15:45:02.266354 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:02.265944    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd" event={"ID":"178c2466-6d9a-4662-95b2-35c601a6c980","Type":"ContainerDied","Data":"10476e681924b48a22a07cbc1552a27d2b9d726e0efdd44e1a877e866c9a9d4f"}
Jul 23 15:45:02.267365 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:02.267348    2575 generic.go:356] "Generic (PLEG): container finished" podID="0f154a5a-38e7-499a-b7b9-d7aa6f217055" containerID="83d5783518d649080662cc7220592ea9b477277f39866228724fd78d9f60edb6" exitCode=0
Jul 23 15:45:02.267439 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:02.267415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw" event={"ID":"0f154a5a-38e7-499a-b7b9-d7aa6f217055","Type":"ContainerDied","Data":"83d5783518d649080662cc7220592ea9b477277f39866228724fd78d9f60edb6"}
Jul 23 15:45:03.411478 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:03.411449    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"
Jul 23 15:45:03.453598 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:03.453563    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd"
Jul 23 15:45:04.280610 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:04.280577    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd"
Jul 23 15:45:04.280610 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:04.280595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747025-hgdfd" event={"ID":"178c2466-6d9a-4662-95b2-35c601a6c980","Type":"ContainerDied","Data":"f45d00897711e6a80b194b38b2286314a360d5b0d986d41ebd27427da07d113d"}
Jul 23 15:45:04.280849 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:04.280675    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f45d00897711e6a80b194b38b2286314a360d5b0d986d41ebd27427da07d113d"
Jul 23 15:45:04.281920 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:04.281901    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"
Jul 23 15:45:04.282053 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:04.281935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw" event={"ID":"0f154a5a-38e7-499a-b7b9-d7aa6f217055","Type":"ContainerDied","Data":"d75a4b83fb98356227f5ae94ccbbc838b520d1b271918a13bb019cd872163efe"}
Jul 23 15:45:04.282053 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:04.281974    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d75a4b83fb98356227f5ae94ccbbc838b520d1b271918a13bb019cd872163efe"
Jul 23 15:45:10.944810 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:10.944711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:45:23.536736 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:45:23.536691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:05.985707 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:05.985670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:06.834156 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:06.834113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:15.817583 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:15.817545    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:15.917951 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:15.917914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:23.046690 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:23.046654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:23.145497 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:23.145450    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:27.659978 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:27.659951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:27.762684 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:27.762648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:27.840097 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:27.840063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:46:53.511962 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:46:53.511924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:47:16.150950 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:16.150912    2575 scope.go:117] "RemoveContainer" containerID="f2667ef2227cfd45c8ff780f704a5cda3e6006984579b3eab98718a08c8f090a"
Jul 23 15:47:31.851731 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:31.851694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:47:49.960506 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:49.960462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:47:50.021187 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:50.021133    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:47:50.407015 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:50.406933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:47:51.301248 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:51.301215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:47:57.071378 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:57.071335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:47:58.688404 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:47:58.688359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:09.271404 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.271316    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"]
Jul 23 15:48:09.271871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.271813    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178c2466-6d9a-4662-95b2-35c601a6c980" containerName="cleanup"
Jul 23 15:48:09.271871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.271827    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="178c2466-6d9a-4662-95b2-35c601a6c980" containerName="cleanup"
Jul 23 15:48:09.271871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.271841    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f154a5a-38e7-499a-b7b9-d7aa6f217055" containerName="cleanup"
Jul 23 15:48:09.271871 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.271847    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f154a5a-38e7-499a-b7b9-d7aa6f217055" containerName="cleanup"
Jul 23 15:48:09.272004 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.271928    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="178c2466-6d9a-4662-95b2-35c601a6c980" containerName="cleanup"
Jul 23 15:48:09.272004 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.271938    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f154a5a-38e7-499a-b7b9-d7aa6f217055" containerName="cleanup"
Jul 23 15:48:09.275157 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.275138    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"
Jul 23 15:48:09.277886 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.277861    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:48:09.281925 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.281864    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"]
Jul 23 15:48:09.328804 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.328763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb4fe4eb-f80c-4162-92d7-3b33b2dd2438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-290c54-gc428\" (UID: \"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"
Jul 23 15:48:09.429556 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.429525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb4fe4eb-f80c-4162-92d7-3b33b2dd2438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-290c54-gc428\" (UID: \"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"
Jul 23 15:48:09.430157 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.430135    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb4fe4eb-f80c-4162-92d7-3b33b2dd2438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-290c54-gc428\" (UID: \"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"
Jul 23 15:48:09.588669 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.588550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"
Jul 23 15:48:09.730009 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.729980    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"]
Jul 23 15:48:09.732467 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:48:09.732439    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4fe4eb_f80c_4162_92d7_3b33b2dd2438.slice/crio-c5fd44d9460ff488c8f9a8167895fd8b0af586584aa7b05d639bc4b8825035fc WatchSource:0}: Error finding container c5fd44d9460ff488c8f9a8167895fd8b0af586584aa7b05d639bc4b8825035fc: Status 404 returned error can't find the container with id c5fd44d9460ff488c8f9a8167895fd8b0af586584aa7b05d639bc4b8825035fc
Jul 23 15:48:09.785014 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.784970    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:09.937934 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:09.937899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:10.242870 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:10.242764    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428" event={"ID":"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438","Type":"ContainerStarted","Data":"dff1bd1b8c1921d7b95ec8e32df2cce7e0c5f5a0c6ee076481754c79431cd582"}
Jul 23 15:48:10.242870 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:10.242832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428" event={"ID":"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438","Type":"ContainerStarted","Data":"c5fd44d9460ff488c8f9a8167895fd8b0af586584aa7b05d639bc4b8825035fc"}
Jul 23 15:48:10.270286 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:10.270231    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428" podStartSLOduration=1.270212297 podStartE2EDuration="1.270212297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:48:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:48:10.267431997 +0000 UTC m=+2874.981363933" watchObservedRunningTime="2026-07-23 15:48:10.270212297 +0000 UTC m=+2874.984144233"
Jul 23 15:48:11.249809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:11.249773    2575 generic.go:356] "Generic (PLEG): container finished" podID="cb4fe4eb-f80c-4162-92d7-3b33b2dd2438" containerID="dff1bd1b8c1921d7b95ec8e32df2cce7e0c5f5a0c6ee076481754c79431cd582" exitCode=0
Jul 23 15:48:11.250258 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:11.249824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428" event={"ID":"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438","Type":"ContainerDied","Data":"dff1bd1b8c1921d7b95ec8e32df2cce7e0c5f5a0c6ee076481754c79431cd582"}
Jul 23 15:48:12.394874 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:12.394851    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"
Jul 23 15:48:12.458610 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:12.458571    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb4fe4eb-f80c-4162-92d7-3b33b2dd2438-maas-api-service-ca\") pod \"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438\" (UID: \"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438\") "
Jul 23 15:48:12.458964 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:12.458939    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb4fe4eb-f80c-4162-92d7-3b33b2dd2438-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cb4fe4eb-f80c-4162-92d7-3b33b2dd2438" (UID: "cb4fe4eb-f80c-4162-92d7-3b33b2dd2438"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:48:12.560272 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:12.560184    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb4fe4eb-f80c-4162-92d7-3b33b2dd2438-maas-api-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:13.260283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:13.260245    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428" event={"ID":"cb4fe4eb-f80c-4162-92d7-3b33b2dd2438","Type":"ContainerDied","Data":"c5fd44d9460ff488c8f9a8167895fd8b0af586584aa7b05d639bc4b8825035fc"}
Jul 23 15:48:13.260283 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:13.260272    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"
Jul 23 15:48:13.260507 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:13.260297    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5fd44d9460ff488c8f9a8167895fd8b0af586584aa7b05d639bc4b8825035fc"
Jul 23 15:48:19.867644 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:19.867614    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"]
Jul 23 15:48:19.868122 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:19.867826    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd" podUID="8af4d440-077b-4255-af4b-7f4938cda8d1" containerName="maas-api" containerID="cri-o://6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68" gracePeriod=30
Jul 23 15:48:19.885839 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:19.885812    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"]
Jul 23 15:48:19.891544 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:19.891514    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-290c54-29747025-r2sdw"]
Jul 23 15:48:19.892106 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:19.892082    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:20.130148 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.130093    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:48:20.233625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.233580    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrrxs\" (UniqueName: \"kubernetes.io/projected/8af4d440-077b-4255-af4b-7f4938cda8d1-kube-api-access-vrrxs\") pod \"8af4d440-077b-4255-af4b-7f4938cda8d1\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") "
Jul 23 15:48:20.233625 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.233625    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af4d440-077b-4255-af4b-7f4938cda8d1-maas-api-tls\") pod \"8af4d440-077b-4255-af4b-7f4938cda8d1\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") "
Jul 23 15:48:20.233838 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.233713    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af4d440-077b-4255-af4b-7f4938cda8d1-openshift-service-ca\") pod \"8af4d440-077b-4255-af4b-7f4938cda8d1\" (UID: \"8af4d440-077b-4255-af4b-7f4938cda8d1\") "
Jul 23 15:48:20.234123 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.234096    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af4d440-077b-4255-af4b-7f4938cda8d1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8af4d440-077b-4255-af4b-7f4938cda8d1" (UID: "8af4d440-077b-4255-af4b-7f4938cda8d1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:48:20.235833 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.235803    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8af4d440-077b-4255-af4b-7f4938cda8d1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8af4d440-077b-4255-af4b-7f4938cda8d1" (UID: "8af4d440-077b-4255-af4b-7f4938cda8d1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:48:20.235833 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.235804    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af4d440-077b-4255-af4b-7f4938cda8d1-kube-api-access-vrrxs" (OuterVolumeSpecName: "kube-api-access-vrrxs") pod "8af4d440-077b-4255-af4b-7f4938cda8d1" (UID: "8af4d440-077b-4255-af4b-7f4938cda8d1"). InnerVolumeSpecName "kube-api-access-vrrxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:20.294842 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.294804    2575 generic.go:356] "Generic (PLEG): container finished" podID="8af4d440-077b-4255-af4b-7f4938cda8d1" containerID="6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68" exitCode=0
Jul 23 15:48:20.295048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.294847    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"
Jul 23 15:48:20.295048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.294893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd" event={"ID":"8af4d440-077b-4255-af4b-7f4938cda8d1","Type":"ContainerDied","Data":"6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68"}
Jul 23 15:48:20.295048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.294951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd" event={"ID":"8af4d440-077b-4255-af4b-7f4938cda8d1","Type":"ContainerDied","Data":"4d6221599fa9acce0a20006512c6664542445fcc19fc5673ea1f9ad38386cbcc"}
Jul 23 15:48:20.295048 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.294985    2575 scope.go:117] "RemoveContainer" containerID="6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68"
Jul 23 15:48:20.304357 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.304340    2575 scope.go:117] "RemoveContainer" containerID="6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68"
Jul 23 15:48:20.304610 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:48:20.304591    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68\": container with ID starting with 6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68 not found: ID does not exist" containerID="6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68"
Jul 23 15:48:20.304676 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.304622    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68"} err="failed to get container status \"6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68\": rpc error: code = NotFound desc = could not find container \"6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68\": container with ID starting with 6b5bcf045cb82a910439dd02df3bbdf41f090e784d100c61386d8ab85b654f68 not found: ID does not exist"
Jul 23 15:48:20.317012 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.316986    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"]
Jul 23 15:48:20.322726 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.322703    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-290c54-7857b7c4d9-sfmkd"]
Jul 23 15:48:20.334853 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.334830    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrrxs\" (UniqueName: \"kubernetes.io/projected/8af4d440-077b-4255-af4b-7f4938cda8d1-kube-api-access-vrrxs\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:20.334940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.334873    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8af4d440-077b-4255-af4b-7f4938cda8d1-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:20.334940 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:20.334885    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8af4d440-077b-4255-af4b-7f4938cda8d1-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:21.866426 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:21.866389    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f154a5a-38e7-499a-b7b9-d7aa6f217055" path="/var/lib/kubelet/pods/0f154a5a-38e7-499a-b7b9-d7aa6f217055/volumes"
Jul 23 15:48:21.866832 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:21.866754    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8af4d440-077b-4255-af4b-7f4938cda8d1" path="/var/lib/kubelet/pods/8af4d440-077b-4255-af4b-7f4938cda8d1/volumes"
Jul 23 15:48:24.361198 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:24.361138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:24.368416 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:24.368383    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"]
Jul 23 15:48:24.371350 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:24.371320    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-290c54-gc428"]
Jul 23 15:48:24.786708 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:24.786669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:25.867002 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:25.866970    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4fe4eb-f80c-4162-92d7-3b33b2dd2438" path="/var/lib/kubelet/pods/cb4fe4eb-f80c-4162-92d7-3b33b2dd2438/volumes"
Jul 23 15:48:31.035116 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.035076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:31.154909 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.154874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:31.322353 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.322263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:31.553022 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.552982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:31.683350 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.683308    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"]
Jul 23 15:48:31.684467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.684439    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4fe4eb-f80c-4162-92d7-3b33b2dd2438" containerName="revoke-keys"
Jul 23 15:48:31.684644 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.684633    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4fe4eb-f80c-4162-92d7-3b33b2dd2438" containerName="revoke-keys"
Jul 23 15:48:31.684785 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.684773    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8af4d440-077b-4255-af4b-7f4938cda8d1" containerName="maas-api"
Jul 23 15:48:31.684858 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.684850    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8af4d440-077b-4255-af4b-7f4938cda8d1" containerName="maas-api"
Jul 23 15:48:31.685107 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.685094    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8af4d440-077b-4255-af4b-7f4938cda8d1" containerName="maas-api"
Jul 23 15:48:31.685241 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.685229    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4fe4eb-f80c-4162-92d7-3b33b2dd2438" containerName="revoke-keys"
Jul 23 15:48:31.689996 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.689877    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"
Jul 23 15:48:31.691252 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.691228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"]
Jul 23 15:48:31.692752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.692717    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:48:31.745840 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.745804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c57e11-19fd-4b40-8990-0a351d188d8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd\" (UID: \"61c57e11-19fd-4b40-8990-0a351d188d8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"
Jul 23 15:48:31.846586 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.846551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c57e11-19fd-4b40-8990-0a351d188d8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd\" (UID: \"61c57e11-19fd-4b40-8990-0a351d188d8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"
Jul 23 15:48:31.847193 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:31.847150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c57e11-19fd-4b40-8990-0a351d188d8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd\" (UID: \"61c57e11-19fd-4b40-8990-0a351d188d8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"
Jul 23 15:48:32.003034 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:32.002953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"
Jul 23 15:48:32.144014 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:32.143989    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"]
Jul 23 15:48:32.146164 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:48:32.146136    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c57e11_19fd_4b40_8990_0a351d188d8d.slice/crio-cf1f3921f378fa9f7ce47372d87167ae50526434061fccddcdd0607cf17ef2f1 WatchSource:0}: Error finding container cf1f3921f378fa9f7ce47372d87167ae50526434061fccddcdd0607cf17ef2f1: Status 404 returned error can't find the container with id cf1f3921f378fa9f7ce47372d87167ae50526434061fccddcdd0607cf17ef2f1
Jul 23 15:48:32.244417 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:32.244380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:32.340652 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:32.340593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:32.362903 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:32.362877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd" event={"ID":"61c57e11-19fd-4b40-8990-0a351d188d8d","Type":"ContainerStarted","Data":"cf1f3921f378fa9f7ce47372d87167ae50526434061fccddcdd0607cf17ef2f1"}
Jul 23 15:48:33.369705 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:33.369660    2575 generic.go:356] "Generic (PLEG): container finished" podID="61c57e11-19fd-4b40-8990-0a351d188d8d" containerID="73ac460e55d470b8da242423bb64e0ebebc98a3acb95712209cfdc973da416df" exitCode=0
Jul 23 15:48:33.370113 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:33.369708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd" event={"ID":"61c57e11-19fd-4b40-8990-0a351d188d8d","Type":"ContainerDied","Data":"73ac460e55d470b8da242423bb64e0ebebc98a3acb95712209cfdc973da416df"}
Jul 23 15:48:34.523851 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:34.523823    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"
Jul 23 15:48:34.564181 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:34.564135    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c57e11-19fd-4b40-8990-0a351d188d8d-maas-api-service-ca\") pod \"61c57e11-19fd-4b40-8990-0a351d188d8d\" (UID: \"61c57e11-19fd-4b40-8990-0a351d188d8d\") "
Jul 23 15:48:34.564458 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:34.564437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c57e11-19fd-4b40-8990-0a351d188d8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61c57e11-19fd-4b40-8990-0a351d188d8d" (UID: "61c57e11-19fd-4b40-8990-0a351d188d8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:48:34.665053 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:34.665019    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61c57e11-19fd-4b40-8990-0a351d188d8d-maas-api-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:35.381237 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:35.381207    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"
Jul 23 15:48:35.381423 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:35.381205    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd" event={"ID":"61c57e11-19fd-4b40-8990-0a351d188d8d","Type":"ContainerDied","Data":"cf1f3921f378fa9f7ce47372d87167ae50526434061fccddcdd0607cf17ef2f1"}
Jul 23 15:48:35.381423 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:35.381334    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf1f3921f378fa9f7ce47372d87167ae50526434061fccddcdd0607cf17ef2f1"
Jul 23 15:48:42.013992 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.013944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:42.068371 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.068336    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"]
Jul 23 15:48:42.068593 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.068545    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s" podUID="9a51e343-b80c-4bc2-b412-a3c60b6e5453" containerName="maas-api" containerID="cri-o://3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c" gracePeriod=30
Jul 23 15:48:42.326423 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.326393    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:48:42.417929 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.417895    2575 generic.go:356] "Generic (PLEG): container finished" podID="9a51e343-b80c-4bc2-b412-a3c60b6e5453" containerID="3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c" exitCode=0
Jul 23 15:48:42.418139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.417937    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"
Jul 23 15:48:42.418139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.417982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s" event={"ID":"9a51e343-b80c-4bc2-b412-a3c60b6e5453","Type":"ContainerDied","Data":"3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c"}
Jul 23 15:48:42.418139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.418046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s" event={"ID":"9a51e343-b80c-4bc2-b412-a3c60b6e5453","Type":"ContainerDied","Data":"6cc47cf5a0681bcd39c00d608636ecaf42da7c0b1541a19eed25a04f3efd561e"}
Jul 23 15:48:42.418139 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.418076    2575 scope.go:117] "RemoveContainer" containerID="3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c"
Jul 23 15:48:42.427099 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.427081    2575 scope.go:117] "RemoveContainer" containerID="3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c"
Jul 23 15:48:42.427377 ip-10-0-142-206 kubenswrapper[2575]: E0723 15:48:42.427357    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c\": container with ID starting with 3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c not found: ID does not exist" containerID="3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c"
Jul 23 15:48:42.427436 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.427387    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c"} err="failed to get container status \"3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c\": rpc error: code = NotFound desc = could not find container \"3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c\": container with ID starting with 3a7e566eecabd2ca66a4bcaeec4c41929b0a9aec93611966ad31868cc0ebea2c not found: ID does not exist"
Jul 23 15:48:42.440802 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.440773    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51e343-b80c-4bc2-b412-a3c60b6e5453-openshift-service-ca\") pod \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") "
Jul 23 15:48:42.440929 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.440822    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls\") pod \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") "
Jul 23 15:48:42.440929 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.440845    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfphs\" (UniqueName: \"kubernetes.io/projected/9a51e343-b80c-4bc2-b412-a3c60b6e5453-kube-api-access-wfphs\") pod \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\" (UID: \"9a51e343-b80c-4bc2-b412-a3c60b6e5453\") "
Jul 23 15:48:42.441249 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.441220    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a51e343-b80c-4bc2-b412-a3c60b6e5453-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a51e343-b80c-4bc2-b412-a3c60b6e5453" (UID: "9a51e343-b80c-4bc2-b412-a3c60b6e5453"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:48:42.442973 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.442951    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a51e343-b80c-4bc2-b412-a3c60b6e5453" (UID: "9a51e343-b80c-4bc2-b412-a3c60b6e5453"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:48:42.443072 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.442996    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a51e343-b80c-4bc2-b412-a3c60b6e5453-kube-api-access-wfphs" (OuterVolumeSpecName: "kube-api-access-wfphs") pod "9a51e343-b80c-4bc2-b412-a3c60b6e5453" (UID: "9a51e343-b80c-4bc2-b412-a3c60b6e5453"). InnerVolumeSpecName "kube-api-access-wfphs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:42.541755 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.541713    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a51e343-b80c-4bc2-b412-a3c60b6e5453-openshift-service-ca\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:42.541755 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.541747    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a51e343-b80c-4bc2-b412-a3c60b6e5453-maas-api-tls\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:42.541755 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.541756    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfphs\" (UniqueName: \"kubernetes.io/projected/9a51e343-b80c-4bc2-b412-a3c60b6e5453-kube-api-access-wfphs\") on node \"ip-10-0-142-206.ec2.internal\" DevicePath \"\""
Jul 23 15:48:42.740420 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.740382    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"]
Jul 23 15:48:42.745067 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:42.745033    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d05e2c-785d56c9d-xmz6s"]
Jul 23 15:48:43.411487 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:43.411442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:43.513190 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:43.513129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:43.865536 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:43.865440    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a51e343-b80c-4bc2-b412-a3c60b6e5453" path="/var/lib/kubelet/pods/9a51e343-b80c-4bc2-b412-a3c60b6e5453/volumes"
Jul 23 15:48:46.750497 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:46.750454    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"]
Jul 23 15:48:46.752710 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:46.752680    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d05e2c-zjmjd"]
Jul 23 15:48:46.753046 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:46.753017    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:47.865866 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:47.865828    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61c57e11-19fd-4b40-8990-0a351d188d8d" path="/var/lib/kubelet/pods/61c57e11-19fd-4b40-8990-0a351d188d8d/volumes"
Jul 23 15:48:48.684764 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:48.684722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:53.356956 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:53.356910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:53.458461 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:53.458414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:53.625547 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:53.625452    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:53.895314 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:53.895219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:48:59.986954 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:48:59.986915    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7qcfr_60fe861d-4b7b-4975-832d-ab3923f4f89d/manager/0.log"
Jul 23 15:49:00.121610 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:00.121579    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dhr95_0159cee4-06fd-4133-bdba-33b1ebb83327/manager/0.log"
Jul 23 15:49:00.257544 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:00.257463    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cd768775d-jh26n_d077c4a1-8845-4bf4-b9a6-f5d1a82074c9/manager/0.log"
Jul 23 15:49:00.758551 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:00.758512    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-j9rf2_05244e10-0a6e-4c15-8e6c-d66fbbe2097b/copy-manifests/0.log"
Jul 23 15:49:00.766102 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:00.766067    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-j9rf2_05244e10-0a6e-4c15-8e6c-d66fbbe2097b/manager/0.log"
Jul 23 15:49:01.262264 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:01.262234    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-769cff4c48-ws4zz_db78ff21-3dcf-403d-a2fe-6e6818186048/maas-api/0.log"
Jul 23 15:49:01.619616 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:01.619531    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747025-hgdfd_178c2466-6d9a-4662-95b2-35c601a6c980/cleanup/0.log"
Jul 23 15:49:01.751460 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:01.751428    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-xx4gs_5a2ed034-8cac-47f4-b28e-3ed07aff312d/postgres/0.log"
Jul 23 15:49:03.360850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:03.360814    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7d547_5e692fb4-d75b-493a-9665-ecb963b39fb3/manager/0.log"
Jul 23 15:49:03.996636 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:03.996603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jjx6m_ffddd863-c5f2-4749-a98f-efec5d02598b/manager/0.log"
Jul 23 15:49:04.490815 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:04.490781    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dbkdk_a13bd47f-82f4-4806-9c3a-40045f2d7a18/discovery/0.log"
Jul 23 15:49:04.707525 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:04.707494    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848d77456-sx4qd_56ce4de6-7d37-46f6-b89e-265e335ad01c/kube-auth-proxy/0.log"
Jul 23 15:49:04.951595 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:04.951558    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnn6t_66e2fc7b-d37f-46f4-a95d-a0021af8b571/payload-pre-processing/0.log"
Jul 23 15:49:05.072735 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:05.072692    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-g2vvq_0f0c2366-2407-4bce-8075-7a683d90ce4e/payload-processing/0.log"
Jul 23 15:49:05.191752 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:05.191723    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68f9d77c4b-q96gh_9b79c5cf-b3e9-47d4-a22e-c6d2e0267556/router/0.log"
Jul 23 15:49:05.556827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:05.556779    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zh7b4_3547f129-5835-4c0a-986c-dbb7d1de54ae/main/0.log"
Jul 23 15:49:05.798846 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:05.798812    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-c4ffb_6e77b26d-dc62-45b8-aca5-ee95a2875157/main/0.log"
Jul 23 15:49:12.054062 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:12.054026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:49:12.154770 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:12.154730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:49:16.044044 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:16.044004    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cr6qw_676860b9-b9bd-469c-9dcb-d05491dbcba2/global-pull-secret-syncer/0.log"
Jul 23 15:49:16.194418 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:16.194392    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log"
Jul 23 15:49:16.350938 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:16.350846    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-206.ec2.internal_42e6b728db4eca8974e361f2558a6eea/haproxy/0.log"
Jul 23 15:49:21.091259 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:21.091230    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7d547_5e692fb4-d75b-493a-9665-ecb963b39fb3/manager/0.log"
Jul 23 15:49:21.506335 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:21.506302    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jjx6m_ffddd863-c5f2-4749-a98f-efec5d02598b/manager/0.log"
Jul 23 15:49:23.229471 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.229436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37dd464b-79ed-43e4-8e6e-2d25ee81e92e/alertmanager/0.log"
Jul 23 15:49:23.258889 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.258853    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37dd464b-79ed-43e4-8e6e-2d25ee81e92e/config-reloader/0.log"
Jul 23 15:49:23.282092 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.282059    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37dd464b-79ed-43e4-8e6e-2d25ee81e92e/kube-rbac-proxy-web/0.log"
Jul 23 15:49:23.309005 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.308973    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37dd464b-79ed-43e4-8e6e-2d25ee81e92e/kube-rbac-proxy/0.log"
Jul 23 15:49:23.340817 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.340780    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37dd464b-79ed-43e4-8e6e-2d25ee81e92e/kube-rbac-proxy-metric/0.log"
Jul 23 15:49:23.368748 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.368721    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37dd464b-79ed-43e4-8e6e-2d25ee81e92e/prom-label-proxy/0.log"
Jul 23 15:49:23.389579 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.389554    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37dd464b-79ed-43e4-8e6e-2d25ee81e92e/init-config-reloader/0.log"
Jul 23 15:49:23.441472 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.441446    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-5cr98_59472e43-47e0-4e3e-bc7d-b013b1329e32/cluster-monitoring-operator/0.log"
Jul 23 15:49:23.623153 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.623123    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-ptkrg_50e9f44a-2279-42fa-9ad5-43bc7e82dfc7/monitoring-plugin/0.log"
Jul 23 15:49:23.832867 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.832785    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzds2_f6bbcebf-0c11-4beb-ac5c-3df71864fa32/node-exporter/0.log"
Jul 23 15:49:23.860857 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.860822    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzds2_f6bbcebf-0c11-4beb-ac5c-3df71864fa32/kube-rbac-proxy/0.log"
Jul 23 15:49:23.886619 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.886587    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzds2_f6bbcebf-0c11-4beb-ac5c-3df71864fa32/init-textfile/0.log"
Jul 23 15:49:23.920028 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.920000    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-j26mq_71a24db4-5933-4e9e-8908-b199e5d1fa8b/kube-rbac-proxy-main/0.log"
Jul 23 15:49:23.943963 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.943929    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-j26mq_71a24db4-5933-4e9e-8908-b199e5d1fa8b/kube-rbac-proxy-self/0.log"
Jul 23 15:49:23.971772 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:23.971739    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-j26mq_71a24db4-5933-4e9e-8908-b199e5d1fa8b/openshift-state-metrics/0.log"
Jul 23 15:49:24.196349 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:24.196316    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fglqm_a36c505d-0409-4d97-bdd4-6f3cc70452d7/prometheus-operator/0.log"
Jul 23 15:49:24.217637 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:24.217609    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fglqm_a36c505d-0409-4d97-bdd4-6f3cc70452d7/kube-rbac-proxy/0.log"
Jul 23 15:49:24.286422 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:24.286393    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74696b984b-rb7tp_0bfc7f61-7ec5-459c-8c31-86cfcca7102a/telemeter-client/0.log"
Jul 23 15:49:24.312178 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:24.312151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74696b984b-rb7tp_0bfc7f61-7ec5-459c-8c31-86cfcca7102a/reload/0.log"
Jul 23 15:49:24.337499 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:24.337459    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74696b984b-rb7tp_0bfc7f61-7ec5-459c-8c31-86cfcca7102a/kube-rbac-proxy/0.log"
Jul 23 15:49:26.325151 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.325107    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"]
Jul 23 15:49:26.325718 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.325697    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a51e343-b80c-4bc2-b412-a3c60b6e5453" containerName="maas-api"
Jul 23 15:49:26.325805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.325721    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a51e343-b80c-4bc2-b412-a3c60b6e5453" containerName="maas-api"
Jul 23 15:49:26.325805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.325751    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c57e11-19fd-4b40-8990-0a351d188d8d" containerName="revoke-keys"
Jul 23 15:49:26.325805 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.325759    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c57e11-19fd-4b40-8990-0a351d188d8d" containerName="revoke-keys"
Jul 23 15:49:26.325957 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.325868    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a51e343-b80c-4bc2-b412-a3c60b6e5453" containerName="maas-api"
Jul 23 15:49:26.325957 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.325884    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c57e11-19fd-4b40-8990-0a351d188d8d" containerName="revoke-keys"
Jul 23 15:49:26.328959 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.328936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.332536 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.332514    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9l4h4\"/\"default-dockercfg-bddm9\""
Jul 23 15:49:26.333644 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.333624    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l4h4\"/\"kube-root-ca.crt\""
Jul 23 15:49:26.333753 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.333653    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l4h4\"/\"openshift-service-ca.crt\""
Jul 23 15:49:26.337499 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.337474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"]
Jul 23 15:49:26.356427 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.356390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-proc\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.356629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.356440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-sys\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.356629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.356457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-lib-modules\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.356629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.356583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fh94\" (UniqueName: \"kubernetes.io/projected/cdafc1a4-db52-4c59-8f01-70e859791d8a-kube-api-access-8fh94\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.356629 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.356617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-podres\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457560 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-proc\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457739 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-sys\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457739 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-sys\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457739 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-proc\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457739 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-lib-modules\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457875 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fh94\" (UniqueName: \"kubernetes.io/projected/cdafc1a4-db52-4c59-8f01-70e859791d8a-kube-api-access-8fh94\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457875 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-podres\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457875 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-lib-modules\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.457970 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.457902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdafc1a4-db52-4c59-8f01-70e859791d8a-podres\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.466447 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.466417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fh94\" (UniqueName: \"kubernetes.io/projected/cdafc1a4-db52-4c59-8f01-70e859791d8a-kube-api-access-8fh94\") pod \"perf-node-gather-daemonset-vllvh\" (UID: \"cdafc1a4-db52-4c59-8f01-70e859791d8a\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.639780 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.639691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:26.783339 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.783313    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"]
Jul 23 15:49:26.785364 ip-10-0-142-206 kubenswrapper[2575]: W0723 15:49:26.785330    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcdafc1a4_db52_4c59_8f01_70e859791d8a.slice/crio-8917ba0ff1cae529503652da28726f6f658eb33682a29425c8bec33eef056db1 WatchSource:0}: Error finding container 8917ba0ff1cae529503652da28726f6f658eb33682a29425c8bec33eef056db1: Status 404 returned error can't find the container with id 8917ba0ff1cae529503652da28726f6f658eb33682a29425c8bec33eef056db1
Jul 23 15:49:26.890186 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:26.890091    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c5596656-4lmz5_724d5a5f-8253-4037-b8a3-4d2e440c75b1/console/0.log"
Jul 23 15:49:27.520052 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:27.520024    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-gtmkz_2113ed1c-891d-4d78-b3ed-2d20b721ea0a/volume-data-source-validator/0.log"
Jul 23 15:49:27.663736 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:27.663701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh" event={"ID":"cdafc1a4-db52-4c59-8f01-70e859791d8a","Type":"ContainerStarted","Data":"a7c62dae8c34d3ec305940715c41a600b05765c60443f9e3435f53d9cea38ea3"}
Jul 23 15:49:27.663913 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:27.663751    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh" event={"ID":"cdafc1a4-db52-4c59-8f01-70e859791d8a","Type":"ContainerStarted","Data":"8917ba0ff1cae529503652da28726f6f658eb33682a29425c8bec33eef056db1"}
Jul 23 15:49:27.663913 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:27.663894    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:27.683151 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:27.683101    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh" podStartSLOduration=1.683083777 podStartE2EDuration="1.683083777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:49:27.682533763 +0000 UTC m=+2952.396465718" watchObservedRunningTime="2026-07-23 15:49:27.683083777 +0000 UTC m=+2952.397015713"
Jul 23 15:49:28.579016 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:28.578912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjh4f_adc6d4ae-cb83-4edc-a035-47563d5ca327/dns/0.log"
Jul 23 15:49:28.599105 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:28.599076    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjh4f_adc6d4ae-cb83-4edc-a035-47563d5ca327/kube-rbac-proxy/0.log"
Jul 23 15:49:28.757359 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:28.757330    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sqtn7_526ec536-972b-4ef3-9912-ff9b52a57905/dns-node-resolver/0.log"
Jul 23 15:49:29.333448 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:29.333413    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-995d89b9-wlw26_be4d1260-b360-44ed-8262-392b19b005f3/registry/0.log"
Jul 23 15:49:29.399520 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:29.399485    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnzhk_3b271b25-7c76-47cf-aa1b-f42e1a9b704f/node-ca/0.log"
Jul 23 15:49:30.587527 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:30.587490    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dbkdk_a13bd47f-82f4-4806-9c3a-40045f2d7a18/discovery/0.log"
Jul 23 15:49:30.642919 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:30.642890    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848d77456-sx4qd_56ce4de6-7d37-46f6-b89e-265e335ad01c/kube-auth-proxy/0.log"
Jul 23 15:49:30.758115 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:30.758084    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnn6t_66e2fc7b-d37f-46f4-a95d-a0021af8b571/payload-pre-processing/0.log"
Jul 23 15:49:30.804984 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:30.804949    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-g2vvq_0f0c2366-2407-4bce-8075-7a683d90ce4e/payload-processing/0.log"
Jul 23 15:49:30.848023 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:30.847925    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68f9d77c4b-q96gh_9b79c5cf-b3e9-47d4-a22e-c6d2e0267556/router/0.log"
Jul 23 15:49:31.567947 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:31.567912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gjctj_d338d08f-b835-442d-bd5a-4b13582ec231/serve-healthcheck-canary/0.log"
Jul 23 15:49:32.050750 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:32.050721    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25nrp_518251d8-a29e-4f66-b11d-fc68cde6ded0/kube-rbac-proxy/0.log"
Jul 23 15:49:32.071308 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:32.071272    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25nrp_518251d8-a29e-4f66-b11d-fc68cde6ded0/exporter/0.log"
Jul 23 15:49:32.098364 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:32.098333    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25nrp_518251d8-a29e-4f66-b11d-fc68cde6ded0/extractor/0.log"
Jul 23 15:49:33.678719 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:33.678692    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-vllvh"
Jul 23 15:49:34.337271 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:34.337232    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7qcfr_60fe861d-4b7b-4975-832d-ab3923f4f89d/manager/0.log"
Jul 23 15:49:34.655827 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:34.655733    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dhr95_0159cee4-06fd-4133-bdba-33b1ebb83327/manager/0.log"
Jul 23 15:49:34.858216 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:34.858160    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cd768775d-jh26n_d077c4a1-8845-4bf4-b9a6-f5d1a82074c9/manager/0.log"
Jul 23 15:49:35.131788 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:35.131754    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-j9rf2_05244e10-0a6e-4c15-8e6c-d66fbbe2097b/manager/0.log"
Jul 23 15:49:35.150969 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:35.150942    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-j9rf2_05244e10-0a6e-4c15-8e6c-d66fbbe2097b/copy-manifests/0.log"
Jul 23 15:49:36.621846 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:36.621744    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2shsv_d2f83c07-b383-4d6b-87ec-8343ac14a6a3/openshift-lws-operator/0.log"
Jul 23 15:49:36.633962 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:36.633929    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dbkdk_a13bd47f-82f4-4806-9c3a-40045f2d7a18/discovery/0.log"
Jul 23 15:49:36.665910 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:36.665883    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848d77456-sx4qd_56ce4de6-7d37-46f6-b89e-265e335ad01c/kube-auth-proxy/0.log"
Jul 23 15:49:36.744809 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:36.744776    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnn6t_66e2fc7b-d37f-46f4-a95d-a0021af8b571/payload-pre-processing/0.log"
Jul 23 15:49:36.777586 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:36.777559    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-g2vvq_0f0c2366-2407-4bce-8075-7a683d90ce4e/payload-processing/0.log"
Jul 23 15:49:36.794942 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:36.794912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68f9d77c4b-q96gh_9b79c5cf-b3e9-47d4-a22e-c6d2e0267556/router/0.log"
Jul 23 15:49:38.192118 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:38.192082    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dbkdk_a13bd47f-82f4-4806-9c3a-40045f2d7a18/discovery/0.log"
Jul 23 15:49:38.223467 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:38.223424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-848d77456-sx4qd_56ce4de6-7d37-46f6-b89e-265e335ad01c/kube-auth-proxy/0.log"
Jul 23 15:49:38.307674 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:38.307586    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fnn6t_66e2fc7b-d37f-46f4-a95d-a0021af8b571/payload-pre-processing/0.log"
Jul 23 15:49:38.336036 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:38.336001    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-g2vvq_0f0c2366-2407-4bce-8075-7a683d90ce4e/payload-processing/0.log"
Jul 23 15:49:38.349835 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:38.349801    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68f9d77c4b-q96gh_9b79c5cf-b3e9-47d4-a22e-c6d2e0267556/router/0.log"
Jul 23 15:49:39.819309 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:39.819279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:49:39.878550 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:39.878485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fs78_6432ee70-0ca6-42a7-aab0-4837a8a0518f/konnectivity-agent/0.log" limit=1024
Jul 23 15:49:43.071143 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.071116    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9645x_9245f8f3-143a-4c8e-9489-9169a0c835ad/kube-multus-additional-cni-plugins/0.log"
Jul 23 15:49:43.091369 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.091339    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9645x_9245f8f3-143a-4c8e-9489-9169a0c835ad/egress-router-binary-copy/0.log"
Jul 23 15:49:43.110601 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.110573    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9645x_9245f8f3-143a-4c8e-9489-9169a0c835ad/cni-plugins/0.log"
Jul 23 15:49:43.130982 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.130956    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9645x_9245f8f3-143a-4c8e-9489-9169a0c835ad/bond-cni-plugin/0.log"
Jul 23 15:49:43.149679 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.149648    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9645x_9245f8f3-143a-4c8e-9489-9169a0c835ad/routeoverride-cni/0.log"
Jul 23 15:49:43.170995 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.170968    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9645x_9245f8f3-143a-4c8e-9489-9169a0c835ad/whereabouts-cni-bincopy/0.log"
Jul 23 15:49:43.189850 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.189823    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9645x_9245f8f3-143a-4c8e-9489-9169a0c835ad/whereabouts-cni/0.log"
Jul 23 15:49:43.296376 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.296346    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w44bd_c41277be-6889-44cf-8587-f6b679eb5385/kube-multus/0.log"
Jul 23 15:49:43.366764 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.366679    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mflwc_5aaed50c-e7c8-4c83-9934-2e4c6e1580c8/network-metrics-daemon/0.log"
Jul 23 15:49:43.388977 ip-10-0-142-206 kubenswrapper[2575]: I0723 15:49:43.388946    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mflwc_5aaed50c-e7c8-4c83-9934-2e4c6e1580c8/kube-rbac-proxy/0.log"