Jul 23 17:57:18.632024 ip-10-0-129-71 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 17:57:19.007097 ip-10-0-129-71 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 17:57:19.007097 ip-10-0-129-71 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 17:57:19.007097 ip-10-0-129-71 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 17:57:19.007097 ip-10-0-129-71 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 17:57:19.007097 ip-10-0-129-71 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 17:57:19.009778 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.009698    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 17:57:19.016731 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016714    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:19.016731 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016729    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:19.016731 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016732    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016735    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016739    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016742    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016745    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016747    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016750    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016753    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016756    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016759    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016762    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016766    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016770    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016773    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016776    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016779    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016782    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016785    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016788    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016790    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:19.016830 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016793    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016795    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016798    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016800    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016803    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016806    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016808    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016811    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016813    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016816    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016819    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016822    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016825    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016827    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016831    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016834    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016837    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016840    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016842    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:19.017291 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016845    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016847    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016850    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016853    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016855    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016858    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016860    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016863    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016866    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016868    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016871    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016873    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016876    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016879    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016881    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016883    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016886    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016888    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016891    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016894    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:19.017764 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016896    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016899    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016901    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016905    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016907    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016911    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016914    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016916    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016919    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016923    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016926    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016929    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016932    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016934    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016937    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016939    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016950    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016955    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016958    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:19.018249 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016961    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016963    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016966    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016968    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016971    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016973    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016976    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016979    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016981    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016984    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016986    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016989    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016992    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016995    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.016997    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017001    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017004    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017006    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017009    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:19.018713 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017666    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017689    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017693    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017696    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017699    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017702    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017705    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017707    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017710    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017713    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017715    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017718    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017721    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017724    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017726    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017729    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017731    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017734    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017736    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017738    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:19.019152 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017741    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017743    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017746    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017748    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017751    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017754    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017756    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017761    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017764    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017769    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017772    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017775    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017778    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017781    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017783    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017786    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017789    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017791    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017794    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:19.019666 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017797    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017800    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017802    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017805    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017808    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017810    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017812    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017815    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017818    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017820    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017823    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017825    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017827    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017830    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017832    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017835    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017837    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017840    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017843    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017845    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:19.020137 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017848    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017850    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017853    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017856    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017858    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017861    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017863    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017866    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017868    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017871    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017873    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017876    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017878    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017881    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017883    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017885    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017888    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017890    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017893    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:19.020616 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017895    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017898    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017900    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017903    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017906    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017909    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017911    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017914    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017917    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017921    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017924    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017927    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017929    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017932    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017935    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017937    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017940    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017946    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017949    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017951    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:19.021096 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.017954    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018292    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018297    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018300    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018302    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018305    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018309    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018313    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018316    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018319    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018321    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018324    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018327    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018330    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018333    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018335    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018338    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018340    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:19.021575 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018343    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018345    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018348    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018350    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018353    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018356    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018359    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018362    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018365    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018368    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018373    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018376    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018379    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018381    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018384    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018387    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018390    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018392    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018395    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018397    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:19.022033 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018400    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018402    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018405    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018407    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018410    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018413    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018415    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018418    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018420    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018422    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018425    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018427    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018430    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018432    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018434    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018437    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018440    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018442    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018445    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018447    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:19.022507 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018450    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018452    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018455    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018457    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018460    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018462    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018465    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018467    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018470    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018472    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018475    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018477    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018480    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018482    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018484    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018487    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018489    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018492    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018494    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018496    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018499    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:19.023004 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018501    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018504    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018506    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018510    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018513    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018515    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018517    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018523    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018526    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018529    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018531    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018534    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018537    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018539    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018541    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018544    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018547    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018549    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018552    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018554    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:19.023493 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.018557    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018624    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018631    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018636    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018640    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018644    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018647    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018653    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018657    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018660    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018662    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018666    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018684    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018688    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018691    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018693    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018696    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018699    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018702    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018708    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018711    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018715    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018718    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018721    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 17:57:19.023979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018725    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018728    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018731    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018734    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018738    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018741    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018744    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018747    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018750    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018754    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018757    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018760    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018763    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018766    2560 flags.go:64] FLAG: --enable-server="true"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018769    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018774    2560 flags.go:64] FLAG: --event-burst="100"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018777    2560 flags.go:64] FLAG: --event-qps="50"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018780    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018783    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018786    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018789    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018792    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018795    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018798    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018801    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 17:57:19.024572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018803    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018806    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018810    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018813    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018817    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018820    2560 flags.go:64] FLAG: --feature-gates=""
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018823    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018826    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018829    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018831    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018834    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018837    2560 flags.go:64] FLAG: --help="false"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018840    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018844    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018847    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018849    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018853    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018856    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018859    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018862    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018864    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018867    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018871    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018874    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 17:57:19.025207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018877    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018880    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018883    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018886    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018889    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018892    2560 flags.go:64] FLAG: --lock-file=""
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018894    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018897    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018900    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018905    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018910    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018912    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018915    2560 flags.go:64] FLAG: --logging-format="text"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018918    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018921    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018924    2560 flags.go:64] FLAG: --manifest-url=""
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018927    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018931    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018934    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018938    2560 flags.go:64] FLAG: --max-pods="110"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018941    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018943    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018946    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018949    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018952    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 17:57:19.026025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018955    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018958    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018964    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018967    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018970    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018976    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018979    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018984    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018987    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018990    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018993    2560 flags.go:64] FLAG: --port="10250"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018996    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.018999    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0972fd5aca5670139"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019002    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019005    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019008    2560 flags.go:64] FLAG: --register-node="true"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019010    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019015    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019018    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019021    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019024    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019027    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019030    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019034    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019036    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 17:57:19.026834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019039    2560 flags.go:64] FLAG: --runonce="false"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019042    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019045    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019048    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019051    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019054    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019057    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019060    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019063    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019067    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019069    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019072    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019075    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019079    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019083    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019085    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019090    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019093    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019096    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019100    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019103    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019110    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019113    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019116    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019121    2560 flags.go:64] FLAG: --v="2"
Jul 23 17:57:19.027433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019125    2560 flags.go:64] FLAG: --version="false"
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019129    2560 flags.go:64] FLAG: --vmodule=""
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019132    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019135    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019259    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019264    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019267    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019270    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019273    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019276    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019279    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019281    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019284    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019287    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019289    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019292    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019295    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019297    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019300    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019302    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:19.028063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019306    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019309    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019311    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019314    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019316    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019319    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019322    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019325    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019327    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019330    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019332    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019336    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019338    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019341    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019343    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019346    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019349    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019351    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019354    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019356    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:19.028589 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019359    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019361    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019364    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019366    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019369    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019371    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019374    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019377    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019379    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019382    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019385    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019387    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019391    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019393    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019396    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019398    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019401    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019403    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019406    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019408    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:19.029105 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019411    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019414    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019416    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019420    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019424    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019427    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019430    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019433    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019436    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019438    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019441    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019443    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019445    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019448    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019450    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019453    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019456    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019458    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019461    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:19.029586 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019466    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019469    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019472    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019475    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019478    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019482    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019484    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019488    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019491    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019494    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019497    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019500    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019503    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019506    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019508    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019511    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019514    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019517    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019520    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:19.030063 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019522    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019524    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019527    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019529    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.019532    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.019537    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.027343    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.027357    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.027376    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.027382    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027436    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027441    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027445    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027448    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027451    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:19.030542 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027454    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027457    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027459    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027462    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027464    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027467    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027470    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027473    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027476    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027478    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027480    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027483    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027485    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027488    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027490    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027493    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027495    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027498    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027500    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027503    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:19.030928 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027506    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027508    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027511    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027514    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027519    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027523    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027526    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027529    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027532    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027534    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027537    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027540    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027542    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027545    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027547    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027550    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027552    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027555    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027558    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027560    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:19.031402 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027563    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027566    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027568    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027571    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027573    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027576    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027578    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027580    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027583    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027585    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027588    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027591    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027593    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027596    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027598    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027602    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027606    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027609    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027612    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:19.031935 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027615    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027618    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027621    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027624    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027627    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027630    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027633    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027637    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027640    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027643    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027645    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027648    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027650    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027653    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027655    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027659    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027662    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027664    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027667    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:19.032391 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027685    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027690    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027693    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027696    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027698    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027701    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027703    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027706    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027708    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027711    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027715    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027717    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027720    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027722    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027725    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:19.032846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027727    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.027732    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027836    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027841    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027844    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027846    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027849    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027852    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027854    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027857    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027860    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027864    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027867    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027870    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:19.033209 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027873    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027876    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027879    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027882    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027884    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027887    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027889    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027892    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027894    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027897    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027900    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027903    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027906    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027909    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027911    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027914    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027916    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027919    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027921    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:19.033545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027924    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027926    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027929    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027931    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027934    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027936    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027939    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027941    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027943    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027946    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027948    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027951    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027953    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027956    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027959    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027961    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027964    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027966    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027969    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027971    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:19.034017 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027974    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027976    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027979    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027981    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027984    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027986    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027989    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027991    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027994    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027996    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.027999    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028001    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028003    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028006    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028008    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028011    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028013    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028016    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028018    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:19.034495 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028020    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028023    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028025    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028028    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028030    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028032    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028035    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028037    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028040    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028043    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028045    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028048    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028050    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028053    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028055    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028058    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028060    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028064    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028067    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028070    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:19.035088 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028074    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028077    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028080    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028082    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028085    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028087    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028090    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028093    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:19.028095    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.028100    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.028197    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.031098    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.032595    2560 server.go:1019] "Starting client certificate rotation"
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.032703    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 17:57:19.035574 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.032737    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 17:57:19.035944 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.035301    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 17:57:19.036377 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.036360    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 17:57:19.049372 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.049351    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 23 17:57:19.051683 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.051657    2560 log.go:25] "Validated CRI v1 image API"
Jul 23 17:57:19.052448 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.052432    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 17:57:19.055735 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.055717    2560 fs.go:135] Filesystem UUIDs: map[5aa6f7cb-8e06-419d-bde0-0b0103fe5c39:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 90f4351f-f100-4823-9939-fdc1301f55ae:/dev/nvme0n1p3]
Jul 23 17:57:19.055807 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.055734    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 17:57:19.061268 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.061170    2560 manager.go:216] Machine: {Timestamp:2026-07-23 17:57:19.059870667 +0000 UTC m=+0.315347884 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099984 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e7c17faec39b9dfc270e1a63f39f SystemUUID:ec25e7c1-7fae-c39b-9dfc-270e1a63f39f BootID:f50cdf17-bb9e-466f-ba12-8690a88381e1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:6e:31:7a:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:6e:31:7a:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:4f:f0:4c:ff:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 17:57:19.061268 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.061266    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 17:57:19.061378 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.061336    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 17:57:19.065427 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.065389    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 17:57:19.065820 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.065429    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-71.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 17:57:19.066476 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.066465    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 17:57:19.066512 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.066478    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 17:57:19.066512 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.066486    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 17:57:19.067361 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.067346    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 17:57:19.069143 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.069107    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 17:57:19.073504 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.073492    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 17:57:19.073605 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.073595    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 17:57:19.073660 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.073623    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 17:57:19.073660 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.073632    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 17:57:19.073660 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.073649    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 17:57:19.073660 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.073658    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 23 17:57:19.073847 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.073666    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 17:57:19.074045 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.074033    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 17:57:19.074094 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.074051    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 17:57:19.074173 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.074156    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 17:57:19.077909 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.077893    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 17:57:19.080345 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.080332    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 17:57:19.080396 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.080362    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 17:57:19.081828 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081816    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 17:57:19.081862 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081833    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 17:57:19.081862 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081840    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 17:57:19.081862 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081845    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 17:57:19.081862 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081853    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 17:57:19.081862 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081861    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081873    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081879    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081885    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081891    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081898    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081904    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081928    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 17:57:19.081992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.081936    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 17:57:19.085011 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.084997    2560 server.go:1268] "Started kubelet"
Jul 23 17:57:19.085152 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.085119    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 17:57:19.085334 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.085283    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 17:57:19.085400 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.085354    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 17:57:19.086456 ip-10-0-129-71 systemd[1]: Started Kubernetes Kubelet.
Jul 23 17:57:19.088497 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.087066    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-71.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 17:57:19.088497 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.087416    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 17:57:19.088497 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.087738    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 17:57:19.088497 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.087739    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 17:57:19.088497 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.087772    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 17:57:19.091573 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.091556    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 17:57:19.097389 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.097367    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 17:57:19.097469 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.097366    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 17:57:19.097832 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.097569    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.098168 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098153    2560 factory.go:55] Registering systemd factory
Jul 23 17:57:19.098168 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098166    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 17:57:19.098298 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098166    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 17:57:19.098298 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098189    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 17:57:19.098298 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098170    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 23 17:57:19.098298 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098294    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 17:57:19.098467 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098304    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 17:57:19.098467 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098443    2560 factory.go:153] Registering CRI-O factory
Jul 23 17:57:19.098467 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098458    2560 factory.go:223] Registration of the crio container factory successfully
Jul 23 17:57:19.098624 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098506    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 17:57:19.098624 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098528    2560 factory.go:103] Registering Raw factory
Jul 23 17:57:19.098624 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098538    2560 manager.go:1196] Started watching for new ooms in manager
Jul 23 17:57:19.098934 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.098922    2560 manager.go:349] Starting recovery of all containers
Jul 23 17:57:19.099655 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.098469    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb1d4f6cf7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.084817655 +0000 UTC m=+0.340294872,LastTimestamp:2026-07-23 17:57:19.084817655 +0000 UTC m=+0.340294872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.102685 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.102641    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 17:57:19.103154 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.103119    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 17:57:19.111271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.111255    2560 manager.go:354] Recovery completed
Jul 23 17:57:19.115314 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.115301    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:19.117190 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.117172    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:19.117271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.117203    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:19.117271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.117213    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:19.118978 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.118965    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 17:57:19.118978 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.118978    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 17:57:19.119102 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.118996    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 17:57:19.119102 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.118969    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:19.119856 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.119841    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:19.119909 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.119872    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:19.119909 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.119885    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:19.120369 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.120309    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb1f3d5f39  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.117188921 +0000 UTC m=+0.372666141,LastTimestamp:2026-07-23 17:57:19.117188921 +0000 UTC m=+0.372666141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.121106 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.121094    2560 policy_none.go:49] "None policy: Start"
Jul 23 17:57:19.121161 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.121112    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 17:57:19.121161 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.121126    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 17:57:19.122902 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.122886    2560 policy_none.go:47] "Start"
Jul 23 17:57:19.131319 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.131245    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb1f3da9c7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-71.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.117208007 +0000 UTC m=+0.372685224,LastTimestamp:2026-07-23 17:57:19.117208007 +0000 UTC m=+0.372685224,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.136501 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.136438    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb1f3dcd8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-71.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.117217163 +0000 UTC m=+0.372694381,LastTimestamp:2026-07-23 17:57:19.117217163 +0000 UTC m=+0.372694381,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.147799 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.147784    2560 manager.go:337] "Starting Device Plugin manager"
Jul 23 17:57:19.147885 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.147811    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 17:57:19.147885 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.147821    2560 server.go:87] "Starting device plugin registration server"
Jul 23 17:57:19.148074 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.148060    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 17:57:19.148140 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.148075    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 17:57:19.148286 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.148274    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 17:57:19.150153 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.148363    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 17:57:19.150153 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.148375    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 17:57:19.150153 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.149327    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 17:57:19.150153 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.149374    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.154076    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-71.ec2.internal.18c4fceb1f3d5f39\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb1f3d5f39  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.117188921 +0000 UTC m=+0.372666141,LastTimestamp:2026-07-23 17:57:19.119857109 +0000 UTC m=+0.375334326,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.164541    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.165668    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.165719    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.165741    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.165776    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.169401    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-71.ec2.internal.18c4fceb1f3da9c7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb1f3da9c7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-71.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.117208007 +0000 UTC m=+0.372685224,LastTimestamp:2026-07-23 17:57:19.119877817 +0000 UTC m=+0.375355035,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.177433 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.170576    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 23 17:57:19.180026 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.179958    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-71.ec2.internal.18c4fceb1f3dcd8b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb1f3dcd8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-71.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.117217163 +0000 UTC m=+0.372694381,LastTimestamp:2026-07-23 17:57:19.119890759 +0000 UTC m=+0.375367979,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.192170 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.192115    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-71.ec2.internal.18c4fceb224852f8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-71.ec2.internal,UID:ip-10-0-129-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-129-71.ec2.internal,},FirstTimestamp:2026-07-23 17:57:19.168238328 +0000 UTC m=+0.423715539,LastTimestamp:2026-07-23 17:57:19.168238328 +0000 UTC m=+0.423715539,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-71.ec2.internal,}"
Jul 23 17:57:19.203124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.203106    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vddd6"
Jul 23 17:57:19.224230 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.224211    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vddd6"
Jul 23 17:57:19.248377 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.248351    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:19.249153 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.249139    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:19.249224 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.249168    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:19.249224 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.249182    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:19.249224 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.249206    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.265939 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.265917    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal"]
Jul 23 17:57:19.266026 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.265974    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:19.268351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.268335    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:19.268434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.268361    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:19.268434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.268371    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:19.270681 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.270663    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:19.271180 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.271161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.271248 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.271196    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:19.271401 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.271383    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:19.271493 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.271411    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:19.271493 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.271424    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:19.272470 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.272453    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:19.272547 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.272484    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:19.272547 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.272499    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:19.273522 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.273506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.273598 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.273535    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:19.274118 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.274104    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:19.274176 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.274128    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:19.274176 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.274136    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:19.278310 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.278297    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.278392 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.278315    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-71.ec2.internal\": node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.299258 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.299232    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-71.ec2.internal\" not found" node="ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.299925 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.299905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65507abf4445ff41dfe58601fa82d0df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal\" (UID: \"65507abf4445ff41dfe58601fa82d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.299989 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.299937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab09ee2af8333859f31ea014dc055c28-config\") pod \"kube-apiserver-proxy-ip-10-0-129-71.ec2.internal\" (UID: \"ab09ee2af8333859f31ea014dc055c28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.299989 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.299961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65507abf4445ff41dfe58601fa82d0df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal\" (UID: \"65507abf4445ff41dfe58601fa82d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.303404 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.303389    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-71.ec2.internal\" not found" node="ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.308933 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.308920    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.400527 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.400481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab09ee2af8333859f31ea014dc055c28-config\") pod \"kube-apiserver-proxy-ip-10-0-129-71.ec2.internal\" (UID: \"ab09ee2af8333859f31ea014dc055c28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.400527 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.400511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65507abf4445ff41dfe58601fa82d0df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal\" (UID: \"65507abf4445ff41dfe58601fa82d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.400527 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.400522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab09ee2af8333859f31ea014dc055c28-config\") pod \"kube-apiserver-proxy-ip-10-0-129-71.ec2.internal\" (UID: \"ab09ee2af8333859f31ea014dc055c28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.400663 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.400527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65507abf4445ff41dfe58601fa82d0df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal\" (UID: \"65507abf4445ff41dfe58601fa82d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.400663 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.400565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65507abf4445ff41dfe58601fa82d0df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal\" (UID: \"65507abf4445ff41dfe58601fa82d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.400663 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.400560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65507abf4445ff41dfe58601fa82d0df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal\" (UID: \"65507abf4445ff41dfe58601fa82d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.409426 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.409413    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.509763 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.509742    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.603394 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.603378    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.606903 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.606889    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:19.609900 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.609881    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.711014 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.710940    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.811511 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.811472    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:19.905908 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:19.905886    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:19.912543 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:19.912525    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:20.013418 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:20.013357    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:20.032167 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.032142    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 17:57:20.032302 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.032279    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 17:57:20.114313 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:20.114285    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-71.ec2.internal\" not found"
Jul 23 17:57:20.118287 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.118274    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:20.198719 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.198687    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:20.214895 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.214871    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 17:57:20.216232 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.216211    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal"
Jul 23 17:57:20.229599 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.229571    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 17:52:19 +0000 UTC" deadline="2027-12-25 08:26:44.018322887 +0000 UTC"
Jul 23 17:57:20.229770 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.229598    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12470h29m23.788727866s"
Jul 23 17:57:20.229770 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.229652    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 17:57:20.359843 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:20.359817    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab09ee2af8333859f31ea014dc055c28.slice/crio-43f5415f1a2ceabd37c3ce08d684ca48dbc8841fba11feb8b59540e7abbe5b48 WatchSource:0}: Error finding container 43f5415f1a2ceabd37c3ce08d684ca48dbc8841fba11feb8b59540e7abbe5b48: Status 404 returned error can't find the container with id 43f5415f1a2ceabd37c3ce08d684ca48dbc8841fba11feb8b59540e7abbe5b48
Jul 23 17:57:20.364396 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.364378    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 17:57:20.408265 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.408234    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:20.422620 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:20.422599    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65507abf4445ff41dfe58601fa82d0df.slice/crio-75a1509f6afbefff3857bd7d7cd06bfde45321402b91112b3a89c935a1c66496 WatchSource:0}: Error finding container 75a1509f6afbefff3857bd7d7cd06bfde45321402b91112b3a89c935a1c66496: Status 404 returned error can't find the container with id 75a1509f6afbefff3857bd7d7cd06bfde45321402b91112b3a89c935a1c66496
Jul 23 17:57:20.533166 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:20.533145    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:21.075845 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.075811    2560 apiserver.go:52] "Watching apiserver"
Jul 23 17:57:21.087014 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.086986    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 17:57:21.087440 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.087413    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal","openshift-multus/multus-additional-cni-plugins-lfrd9","openshift-network-diagnostics/network-check-target-mvlhs","openshift-network-operator/iptables-alerter-tnl2x","kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk","openshift-cluster-node-tuning-operator/tuned-dvb5v","openshift-multus/multus-fdp7m","openshift-multus/network-metrics-daemon-7lxtj","openshift-ovn-kubernetes/ovnkube-node-4d9v5","kube-system/global-pull-secret-syncer-hwfr9","kube-system/konnectivity-agent-4c6fs","openshift-dns/node-resolver-fg5p8","openshift-image-registry/node-ca-pjfjn"]
Jul 23 17:57:21.090230 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.089886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.093585 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.093566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.093697 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.093633    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:21.094290 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.094256    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwxqh\""
Jul 23 17:57:21.094384 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.094313    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 17:57:21.095868 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.095842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:21.095958 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.095903    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:21.098063 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.098040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.098284 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.098268    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 17:57:21.100248 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.100227    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.101954 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.101932    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 17:57:21.102577 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.102536    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.104699 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.104665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:21.104791 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.104744    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108763    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-modprobe-d\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108810    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-run\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-tuned\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-kubelet-config\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2pl2\" (UniqueName: \"kubernetes.io/projected/ed776bb4-003c-4b69-a130-36e46e65ab94-kube-api-access-l2pl2\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108955    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.108969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysconfig\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-lib-modules\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fab13a-6be4-44ef-8bca-ea378ff7076c-tmp\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109030    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109059    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109074    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knth6\" (UniqueName: \"kubernetes.io/projected/20fab13a-6be4-44ef-8bca-ea378ff7076c-kube-api-access-knth6\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109145    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed776bb4-003c-4b69-a130-36e46e65ab94-host-slash\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4356b5d1-a41e-48d6-8337-a0fcd446e859-host\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.109349 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k89pc\" (UniqueName: \"kubernetes.io/projected/4356b5d1-a41e-48d6-8337-a0fcd446e859-kube-api-access-k89pc\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-kubernetes\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysctl-d\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysctl-conf\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-sys\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-var-lib-kubelet\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-dbus\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-systemd\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109444    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zz257\""
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed776bb4-003c-4b69-a130-36e46e65ab94-iptables-alerter-script\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4356b5d1-a41e-48d6-8337-a0fcd446e859-serviceca\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-host\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109637    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kz72\""
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109663    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109725    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qpgt\""
Jul 23 17:57:21.110410 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.109792    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 17:57:21.111371 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.111351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.113848 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.113757    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.116154 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.116138    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.118425 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.118406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.120300 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120282    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 17:57:21.120435 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120412    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 17:57:21.120532 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120481    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 17:57:21.120532 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c6z4k\""
Jul 23 17:57:21.120532 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120519    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 17:57:21.120707 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 17:57:21.120861 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120845    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 17:57:21.120932 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120880    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zngnw\""
Jul 23 17:57:21.120932 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.120913    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 17:57:21.121030 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.121015    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 17:57:21.121668 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.121649    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6c7n8\""
Jul 23 17:57:21.124089 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.124068    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 17:57:21.124178 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.124075    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 17:57:21.125074 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.125055    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 17:57:21.125150 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.125092    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 17:57:21.125150 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.125095    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 17:57:21.129358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.129341    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2c8v8\""
Jul 23 17:57:21.136532 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.136517    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 17:57:21.136622 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.136544    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 17:57:21.136948 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.136934    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 17:57:21.141052 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.141032    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4g46k\""
Jul 23 17:57:21.150130 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.150113    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 17:57:21.169237 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.169200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal" event={"ID":"ab09ee2af8333859f31ea014dc055c28","Type":"ContainerStarted","Data":"43f5415f1a2ceabd37c3ce08d684ca48dbc8841fba11feb8b59540e7abbe5b48"}
Jul 23 17:57:21.170299 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.170279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal" event={"ID":"65507abf4445ff41dfe58601fa82d0df","Type":"ContainerStarted","Data":"75a1509f6afbefff3857bd7d7cd06bfde45321402b91112b3a89c935a1c66496"}
Jul 23 17:57:21.174462 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.174444    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2h55m"
Jul 23 17:57:21.184898 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.184808    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2h55m"
Jul 23 17:57:21.199446 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.199424    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 17:57:21.210135 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-var-lib-kubelet\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.210229 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.210229 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-slash\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.210229 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-cni-bin\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.210229 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-ovnkube-config\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.210424 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-netns\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.210424 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-cni-bin\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.210424 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-var-lib-kubelet\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.210424 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-cni-binary-copy\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.210613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-kubelet\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.210613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-run-netns\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.210613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-system-cni-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.210613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knth6\" (UniqueName: \"kubernetes.io/projected/20fab13a-6be4-44ef-8bca-ea378ff7076c-kube-api-access-knth6\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.210613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k89pc\" (UniqueName: \"kubernetes.io/projected/4356b5d1-a41e-48d6-8337-a0fcd446e859-kube-api-access-k89pc\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.210613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4830057f-27c4-41b5-aee8-4ca6993a9769-konnectivity-ca\") pod \"konnectivity-agent-4c6fs\" (UID: \"4830057f-27c4-41b5-aee8-4ca6993a9769\") " pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.210613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysctl-conf\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gzcr\" (UniqueName: \"kubernetes.io/projected/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-kube-api-access-8gzcr\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-system-cni-dir\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-registration-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-systemd\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4356b5d1-a41e-48d6-8337-a0fcd446e859-serviceca\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-os-release\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.210928 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.210973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysctl-conf\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-env-overrides\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-cnibin\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2839ba52-6b89-4e06-b157-a78f9ce39351-cni-binary-copy\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-host\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-modprobe-d\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-tuned\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-kubelet-config\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-node-log\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-k8s-cni-cncf-io\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4356b5d1-a41e-48d6-8337-a0fcd446e859-serviceca\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-kubelet\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4356b5d1-a41e-48d6-8337-a0fcd446e859-host\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-systemd\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-var-lib-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-kubernetes\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-modprobe-d\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-kubelet-config\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-sys\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-socket-dir-parent\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-kubernetes\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.211573 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-cni-multus\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-conf-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-host\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed776bb4-003c-4b69-a130-36e46e65ab94-iptables-alerter-script\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-tmp-dir\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211686    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-sys\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4356b5d1-a41e-48d6-8337-a0fcd446e859-host\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-sys-fs\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-systemd\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdbvq\" (UniqueName: \"kubernetes.io/projected/2839ba52-6b89-4e06-b157-a78f9ce39351-kube-api-access-tdbvq\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.211983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm5kt\" (UniqueName: \"kubernetes.io/projected/18dcd755-1801-4494-b4b9-f668a3f05872-kube-api-access-sm5kt\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.212035    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4830057f-27c4-41b5-aee8-4ca6993a9769-agent-certs\") pod \"konnectivity-agent-4c6fs\" (UID: \"4830057f-27c4-41b5-aee8-4ca6993a9769\") " pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.212319 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.212145    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret podName:67ada2d4-7c84-4cd2-ade4-67ceac12ea6e nodeName:}" failed. No retries permitted until 2026-07-23 17:57:21.712112511 +0000 UTC m=+2.967589720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret") pod "global-pull-secret-syncer-hwfr9" (UID: "67ada2d4-7c84-4cd2-ade4-67ceac12ea6e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-device-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed776bb4-003c-4b69-a130-36e46e65ab94-iptables-alerter-script\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flpnl\" (UniqueName: \"kubernetes.io/projected/c868ef87-bfe0-4e3e-a396-9f0f4737c844-kube-api-access-flpnl\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-systemd-units\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-cni-netd\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-hosts-file\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-cnibin\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-ovn\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80f63878-70df-40dd-b8da-8d124ebe49c6-ovn-node-metrics-cert\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-os-release\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-hostroot\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-dbus\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-etc-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjxf\" (UniqueName: \"kubernetes.io/projected/80f63878-70df-40dd-b8da-8d124ebe49c6-kube-api-access-svjxf\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-cni-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-daemon-config\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-multus-certs\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-run\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2pl2\" (UniqueName: \"kubernetes.io/projected/ed776bb4-003c-4b69-a130-36e46e65ab94-kube-api-access-l2pl2\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-etc-kubernetes\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysconfig\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-lib-modules\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fab13a-6be4-44ef-8bca-ea378ff7076c-tmp\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.212947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed776bb4-003c-4b69-a130-36e46e65ab94-host-slash\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtr2c\" (UniqueName: \"kubernetes.io/projected/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-kube-api-access-rtr2c\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-dbus\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-socket-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-log-socket\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-ovnkube-script-lib\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.213879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-run\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.214631 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysctl-d\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.214631 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed776bb4-003c-4b69-a130-36e46e65ab94-host-slash\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.214631 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysctl-d\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.214631 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-sysconfig\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.214631 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.213399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20fab13a-6be4-44ef-8bca-ea378ff7076c-lib-modules\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.215716 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.215692    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20fab13a-6be4-44ef-8bca-ea378ff7076c-etc-tuned\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.215815 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.215778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fab13a-6be4-44ef-8bca-ea378ff7076c-tmp\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.222636 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.222475    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:21.222636 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.222496    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:21.222636 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.222509    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4vdd8 for pod openshift-network-diagnostics/network-check-target-mvlhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:21.222636 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.222562    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8 podName:aedbaca7-4f48-4a56-80f5-9d98e4db99ba nodeName:}" failed. No retries permitted until 2026-07-23 17:57:21.722549853 +0000 UTC m=+2.978027057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4vdd8" (UniqueName: "kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8") pod "network-check-target-mvlhs" (UID: "aedbaca7-4f48-4a56-80f5-9d98e4db99ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:21.222955 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.222862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knth6\" (UniqueName: \"kubernetes.io/projected/20fab13a-6be4-44ef-8bca-ea378ff7076c-kube-api-access-knth6\") pod \"tuned-dvb5v\" (UID: \"20fab13a-6be4-44ef-8bca-ea378ff7076c\") " pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.224030 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.224012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k89pc\" (UniqueName: \"kubernetes.io/projected/4356b5d1-a41e-48d6-8337-a0fcd446e859-kube-api-access-k89pc\") pod \"node-ca-pjfjn\" (UID: \"4356b5d1-a41e-48d6-8337-a0fcd446e859\") " pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.224572 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.224550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2pl2\" (UniqueName: \"kubernetes.io/projected/ed776bb4-003c-4b69-a130-36e46e65ab94-kube-api-access-l2pl2\") pod \"iptables-alerter-tnl2x\" (UID: \"ed776bb4-003c-4b69-a130-36e46e65ab94\") " pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.314183 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-system-cni-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314307 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4830057f-27c4-41b5-aee8-4ca6993a9769-konnectivity-ca\") pod \"konnectivity-agent-4c6fs\" (UID: \"4830057f-27c4-41b5-aee8-4ca6993a9769\") " pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.314307 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.314307 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gzcr\" (UniqueName: \"kubernetes.io/projected/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-kube-api-access-8gzcr\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:21.314307 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-system-cni-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314307 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-system-cni-dir\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.314307 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-registration-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-os-release\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-env-overrides\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-cnibin\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2839ba52-6b89-4e06-b157-a78f9ce39351-cni-binary-copy\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-node-log\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-k8s-cni-cncf-io\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-kubelet\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-var-lib-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-socket-dir-parent\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-cni-multus\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.314640 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-conf-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-tmp-dir\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-sys-fs\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-systemd\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdbvq\" (UniqueName: \"kubernetes.io/projected/2839ba52-6b89-4e06-b157-a78f9ce39351-kube-api-access-tdbvq\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm5kt\" (UniqueName: \"kubernetes.io/projected/18dcd755-1801-4494-b4b9-f668a3f05872-kube-api-access-sm5kt\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4830057f-27c4-41b5-aee8-4ca6993a9769-agent-certs\") pod \"konnectivity-agent-4c6fs\" (UID: \"4830057f-27c4-41b5-aee8-4ca6993a9769\") " pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4830057f-27c4-41b5-aee8-4ca6993a9769-konnectivity-ca\") pod \"konnectivity-agent-4c6fs\" (UID: \"4830057f-27c4-41b5-aee8-4ca6993a9769\") " pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-device-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-device-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.314993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flpnl\" (UniqueName: \"kubernetes.io/projected/c868ef87-bfe0-4e3e-a396-9f0f4737c844-kube-api-access-flpnl\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-systemd-units\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-cni-netd\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-hosts-file\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-cnibin\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.315203 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-ovn\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-system-cni-dir\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80f63878-70df-40dd-b8da-8d124ebe49c6-ovn-node-metrics-cert\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-os-release\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-hostroot\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-etc-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjxf\" (UniqueName: \"kubernetes.io/projected/80f63878-70df-40dd-b8da-8d124ebe49c6-kube-api-access-svjxf\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-cni-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315327    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-daemon-config\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-cnibin\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-multus-certs\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-etc-kubernetes\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtr2c\" (UniqueName: \"kubernetes.io/projected/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-kube-api-access-rtr2c\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.316003 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-socket-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-log-socket\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-ovnkube-script-lib\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-slash\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-cni-bin\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-ovnkube-config\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-netns\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-cni-bin\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-cni-binary-copy\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-kubelet\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-run-netns\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-run-netns\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2839ba52-6b89-4e06-b157-a78f9ce39351-cni-binary-copy\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-var-lib-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-node-log\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-k8s-cni-cncf-io\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.316860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-socket-dir-parent\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-kubelet\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-cni-multus\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-etc-openvswitch\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.315254    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-registration-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-os-release\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-conf-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-tmp-dir\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-multus-certs\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-env-overrides\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-etc-kubernetes\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-daemon-config\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-socket-dir\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-log-socket\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.317632 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.318351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.318351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317730    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-ovnkube-script-lib\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.318351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-slash\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.318351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-sys-fs\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.318351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317835    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-systemd\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.318351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-cni-bin\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.318351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.317884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c868ef87-bfe0-4e3e-a396-9f0f4737c844-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.318699 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dcd755-1801-4494-b4b9-f668a3f05872-cnibin\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.318699 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.318484    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:21.318699 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.318535    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:21.818516854 +0000 UTC m=+3.073994060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:21.318863 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-systemd-units\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.318863 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-cni-netd\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.318863 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dcd755-1801-4494-b4b9-f668a3f05872-cni-binary-copy\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.319015 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-hosts-file\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.319015 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80f63878-70df-40dd-b8da-8d124ebe49c6-ovnkube-config\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.319015 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-kubelet\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.319015 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-run-netns\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.319015 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.318964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-host-var-lib-cni-bin\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.319247 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.319050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-run-ovn\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.319247 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.319090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80f63878-70df-40dd-b8da-8d124ebe49c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.319247 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.319130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-hostroot\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.319247 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.319190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-os-release\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.319247 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.316333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2839ba52-6b89-4e06-b157-a78f9ce39351-multus-cni-dir\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.320870 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.320846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4830057f-27c4-41b5-aee8-4ca6993a9769-agent-certs\") pod \"konnectivity-agent-4c6fs\" (UID: \"4830057f-27c4-41b5-aee8-4ca6993a9769\") " pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.321253 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.321231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80f63878-70df-40dd-b8da-8d124ebe49c6-ovn-node-metrics-cert\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.329742 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.329693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtr2c\" (UniqueName: \"kubernetes.io/projected/aa7f41bd-482d-4bd6-92c9-e2680f3d98a9-kube-api-access-rtr2c\") pod \"node-resolver-fg5p8\" (UID: \"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9\") " pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.329890 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.329868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjxf\" (UniqueName: \"kubernetes.io/projected/80f63878-70df-40dd-b8da-8d124ebe49c6-kube-api-access-svjxf\") pod \"ovnkube-node-4d9v5\" (UID: \"80f63878-70df-40dd-b8da-8d124ebe49c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.331506 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.331481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gzcr\" (UniqueName: \"kubernetes.io/projected/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-kube-api-access-8gzcr\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:21.334877 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.334859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flpnl\" (UniqueName: \"kubernetes.io/projected/c868ef87-bfe0-4e3e-a396-9f0f4737c844-kube-api-access-flpnl\") pod \"aws-ebs-csi-driver-node-kbwnk\" (UID: \"c868ef87-bfe0-4e3e-a396-9f0f4737c844\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.336729 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.336649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdbvq\" (UniqueName: \"kubernetes.io/projected/2839ba52-6b89-4e06-b157-a78f9ce39351-kube-api-access-tdbvq\") pod \"multus-fdp7m\" (UID: \"2839ba52-6b89-4e06-b157-a78f9ce39351\") " pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.336936 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.336904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm5kt\" (UniqueName: \"kubernetes.io/projected/18dcd755-1801-4494-b4b9-f668a3f05872-kube-api-access-sm5kt\") pod \"multus-additional-cni-plugins-lfrd9\" (UID: \"18dcd755-1801-4494-b4b9-f668a3f05872\") " pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.400442 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.400419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dvb5v"
Jul 23 17:57:21.411271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.411250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tnl2x"
Jul 23 17:57:21.419996 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.419978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pjfjn"
Jul 23 17:57:21.425651 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.425627    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk"
Jul 23 17:57:21.431631 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.431603    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fg5p8"
Jul 23 17:57:21.439156 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.439134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lfrd9"
Jul 23 17:57:21.444920 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.444901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:21.452691 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.452658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fdp7m"
Jul 23 17:57:21.458310 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.458293    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:21.717971 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.717896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:21.718117 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.718034    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:21.718117 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.718097    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret podName:67ada2d4-7c84-4cd2-ade4-67ceac12ea6e nodeName:}" failed. No retries permitted until 2026-07-23 17:57:22.718077442 +0000 UTC m=+3.973554689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret") pod "global-pull-secret-syncer-hwfr9" (UID: "67ada2d4-7c84-4cd2-ade4-67ceac12ea6e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:21.818178 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.818145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:21.818321 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.818266    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:21.818321 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.818281    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:21.818321 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.818290    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4vdd8 for pod openshift-network-diagnostics/network-check-target-mvlhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:21.818438 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.818337    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8 podName:aedbaca7-4f48-4a56-80f5-9d98e4db99ba nodeName:}" failed. No retries permitted until 2026-07-23 17:57:22.818324669 +0000 UTC m=+4.073801873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vdd8" (UniqueName: "kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8") pod "network-check-target-mvlhs" (UID: "aedbaca7-4f48-4a56-80f5-9d98e4db99ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:21.918988 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:21.918958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:21.919156 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.919087    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:21.919156 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:21.919144    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:22.919130041 +0000 UTC m=+4.174607246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:22.188040 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:22.187978    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:52:21 +0000 UTC" deadline="2028-05-04 22:52:46.455860318 +0000 UTC"
Jul 23 17:57:22.188040 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:22.188034    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15628h55m24.267830644s"
Jul 23 17:57:22.393224 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:22.393198    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:22.443368 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.443343    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f63878_70df_40dd_b8da_8d124ebe49c6.slice/crio-a12e0d0c0c409374d610dc3baf759662da9be1372363120ac9ba2d3673c5a200 WatchSource:0}: Error finding container a12e0d0c0c409374d610dc3baf759662da9be1372363120ac9ba2d3673c5a200: Status 404 returned error can't find the container with id a12e0d0c0c409374d610dc3baf759662da9be1372363120ac9ba2d3673c5a200
Jul 23 17:57:22.444406 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.444384    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4356b5d1_a41e_48d6_8337_a0fcd446e859.slice/crio-19a53d481fefc400cdece74b672b16885cbafd4802c0fe3b2a8a69920b9308fd WatchSource:0}: Error finding container 19a53d481fefc400cdece74b672b16885cbafd4802c0fe3b2a8a69920b9308fd: Status 404 returned error can't find the container with id 19a53d481fefc400cdece74b672b16885cbafd4802c0fe3b2a8a69920b9308fd
Jul 23 17:57:22.445410 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.445387    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dcd755_1801_4494_b4b9_f668a3f05872.slice/crio-7b6f8199acda5c2e0395c2d431964a37134bc43fc00e4ae29407bcc29c6fdc5d WatchSource:0}: Error finding container 7b6f8199acda5c2e0395c2d431964a37134bc43fc00e4ae29407bcc29c6fdc5d: Status 404 returned error can't find the container with id 7b6f8199acda5c2e0395c2d431964a37134bc43fc00e4ae29407bcc29c6fdc5d
Jul 23 17:57:22.447300 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.447104    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fab13a_6be4_44ef_8bca_ea378ff7076c.slice/crio-384caced0439cd9648c1b595c9839ef69df342d824001655986658ff4b563312 WatchSource:0}: Error finding container 384caced0439cd9648c1b595c9839ef69df342d824001655986658ff4b563312: Status 404 returned error can't find the container with id 384caced0439cd9648c1b595c9839ef69df342d824001655986658ff4b563312
Jul 23 17:57:22.447818 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.447793    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4830057f_27c4_41b5_aee8_4ca6993a9769.slice/crio-276c8ad682cc30013ad0073c8bc71a666935c3f7a95fd37a035ce586b3f69345 WatchSource:0}: Error finding container 276c8ad682cc30013ad0073c8bc71a666935c3f7a95fd37a035ce586b3f69345: Status 404 returned error can't find the container with id 276c8ad682cc30013ad0073c8bc71a666935c3f7a95fd37a035ce586b3f69345
Jul 23 17:57:22.449184 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.448898    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2839ba52_6b89_4e06_b157_a78f9ce39351.slice/crio-9c25bd8c1792d26a0b33814b4e85fafee90c66a1335478635b9f27afaf3649d7 WatchSource:0}: Error finding container 9c25bd8c1792d26a0b33814b4e85fafee90c66a1335478635b9f27afaf3649d7: Status 404 returned error can't find the container with id 9c25bd8c1792d26a0b33814b4e85fafee90c66a1335478635b9f27afaf3649d7
Jul 23 17:57:22.453849 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.453571    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc868ef87_bfe0_4e3e_a396_9f0f4737c844.slice/crio-4f01513002c88d68f928fc783b7587318400a83c5ae00d2fde6632b15a9d4f5a WatchSource:0}: Error finding container 4f01513002c88d68f928fc783b7587318400a83c5ae00d2fde6632b15a9d4f5a: Status 404 returned error can't find the container with id 4f01513002c88d68f928fc783b7587318400a83c5ae00d2fde6632b15a9d4f5a
Jul 23 17:57:22.454119 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.454069    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7f41bd_482d_4bd6_92c9_e2680f3d98a9.slice/crio-a9ff1d8eb9bc7ec731bb0cec8efa0bb28f4fb8355079ad3284cf62c8b7f007fe WatchSource:0}: Error finding container a9ff1d8eb9bc7ec731bb0cec8efa0bb28f4fb8355079ad3284cf62c8b7f007fe: Status 404 returned error can't find the container with id a9ff1d8eb9bc7ec731bb0cec8efa0bb28f4fb8355079ad3284cf62c8b7f007fe
Jul 23 17:57:22.454936 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:22.454919    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded776bb4_003c_4b69_a130_36e46e65ab94.slice/crio-99b2f09355ce90018302c2b1e7f2c4690eed7f5c39ade0b7aae6e76672521750 WatchSource:0}: Error finding container 99b2f09355ce90018302c2b1e7f2c4690eed7f5c39ade0b7aae6e76672521750: Status 404 returned error can't find the container with id 99b2f09355ce90018302c2b1e7f2c4690eed7f5c39ade0b7aae6e76672521750
Jul 23 17:57:22.724580 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:22.724559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:22.724720 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.724705    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:22.724780 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.724768    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret podName:67ada2d4-7c84-4cd2-ade4-67ceac12ea6e nodeName:}" failed. No retries permitted until 2026-07-23 17:57:24.724747575 +0000 UTC m=+5.980224781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret") pod "global-pull-secret-syncer-hwfr9" (UID: "67ada2d4-7c84-4cd2-ade4-67ceac12ea6e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:22.825300 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:22.825270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:22.825401 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.825384    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:22.825401 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.825397    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:22.825489 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.825405    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4vdd8 for pod openshift-network-diagnostics/network-check-target-mvlhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:22.825489 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.825443    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8 podName:aedbaca7-4f48-4a56-80f5-9d98e4db99ba nodeName:}" failed. No retries permitted until 2026-07-23 17:57:24.825432088 +0000 UTC m=+6.080909292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vdd8" (UniqueName: "kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8") pod "network-check-target-mvlhs" (UID: "aedbaca7-4f48-4a56-80f5-9d98e4db99ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:22.925847 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:22.925813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:22.926017 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.925944    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:22.926017 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:22.926004    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:24.925985259 +0000 UTC m=+6.181462466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:23.167276 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.166792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:23.167276 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:23.166929    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:23.167276 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.166801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:23.167276 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:23.167100    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:23.167276 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.167165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:23.167276 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:23.167238    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:23.181711 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.181664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk" event={"ID":"c868ef87-bfe0-4e3e-a396-9f0f4737c844","Type":"ContainerStarted","Data":"4f01513002c88d68f928fc783b7587318400a83c5ae00d2fde6632b15a9d4f5a"}
Jul 23 17:57:23.186900 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.186873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4c6fs" event={"ID":"4830057f-27c4-41b5-aee8-4ca6993a9769","Type":"ContainerStarted","Data":"276c8ad682cc30013ad0073c8bc71a666935c3f7a95fd37a035ce586b3f69345"}
Jul 23 17:57:23.189310 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.189176    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:52:21 +0000 UTC" deadline="2028-01-10 17:38:13.578434365 +0000 UTC"
Jul 23 17:57:23.189310 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.189286    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12863h40m50.389153566s"
Jul 23 17:57:23.190238 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.190136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dvb5v" event={"ID":"20fab13a-6be4-44ef-8bca-ea378ff7076c","Type":"ContainerStarted","Data":"384caced0439cd9648c1b595c9839ef69df342d824001655986658ff4b563312"}
Jul 23 17:57:23.196889 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.196812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerStarted","Data":"7b6f8199acda5c2e0395c2d431964a37134bc43fc00e4ae29407bcc29c6fdc5d"}
Jul 23 17:57:23.200337 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.200277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pjfjn" event={"ID":"4356b5d1-a41e-48d6-8337-a0fcd446e859","Type":"ContainerStarted","Data":"19a53d481fefc400cdece74b672b16885cbafd4802c0fe3b2a8a69920b9308fd"}
Jul 23 17:57:23.202932 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.202809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"a12e0d0c0c409374d610dc3baf759662da9be1372363120ac9ba2d3673c5a200"}
Jul 23 17:57:23.212280 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.212252    2560 generic.go:356] "Generic (PLEG): container finished" podID="65507abf4445ff41dfe58601fa82d0df" containerID="c46fc58f395a6fcc41e425b8db700858e5a3b9c77e0812a501c4e3f275f370b6" exitCode=0
Jul 23 17:57:23.212695 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.212514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal" event={"ID":"65507abf4445ff41dfe58601fa82d0df","Type":"ContainerDied","Data":"c46fc58f395a6fcc41e425b8db700858e5a3b9c77e0812a501c4e3f275f370b6"}
Jul 23 17:57:23.220434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.220408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fg5p8" event={"ID":"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9","Type":"ContainerStarted","Data":"a9ff1d8eb9bc7ec731bb0cec8efa0bb28f4fb8355079ad3284cf62c8b7f007fe"}
Jul 23 17:57:23.232351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.232325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fdp7m" event={"ID":"2839ba52-6b89-4e06-b157-a78f9ce39351","Type":"ContainerStarted","Data":"9c25bd8c1792d26a0b33814b4e85fafee90c66a1335478635b9f27afaf3649d7"}
Jul 23 17:57:23.245400 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.245375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal" event={"ID":"ab09ee2af8333859f31ea014dc055c28","Type":"ContainerStarted","Data":"8e46ed1a31f1ad92b5c6ba86811e6476bd9b2ba1091340e2a6d1bf80b359e8ff"}
Jul 23 17:57:23.284326 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:23.284240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tnl2x" event={"ID":"ed776bb4-003c-4b69-a130-36e46e65ab94","Type":"ContainerStarted","Data":"99b2f09355ce90018302c2b1e7f2c4690eed7f5c39ade0b7aae6e76672521750"}
Jul 23 17:57:24.301765 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:24.301730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal" event={"ID":"65507abf4445ff41dfe58601fa82d0df","Type":"ContainerStarted","Data":"5042a36df1188ae05d9ac52a089f4931b39e7839bdfbc1cd6770408a01fc1c3f"}
Jul 23 17:57:24.330889 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:24.330826    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-71.ec2.internal" podStartSLOduration=4.330806484 podStartE2EDuration="4.330806484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:23.272365799 +0000 UTC m=+4.527843025" watchObservedRunningTime="2026-07-23 17:57:24.330806484 +0000 UTC m=+5.586283710"
Jul 23 17:57:24.739935 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:24.739850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:24.740137 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.740044    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:24.740137 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.740105    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret podName:67ada2d4-7c84-4cd2-ade4-67ceac12ea6e nodeName:}" failed. No retries permitted until 2026-07-23 17:57:28.740089027 +0000 UTC m=+9.995566235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret") pod "global-pull-secret-syncer-hwfr9" (UID: "67ada2d4-7c84-4cd2-ade4-67ceac12ea6e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:24.841047 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:24.841011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:24.841236 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.841171    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:24.841236 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.841191    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:24.841236 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.841205    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4vdd8 for pod openshift-network-diagnostics/network-check-target-mvlhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:24.841392 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.841262    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8 podName:aedbaca7-4f48-4a56-80f5-9d98e4db99ba nodeName:}" failed. No retries permitted until 2026-07-23 17:57:28.841242722 +0000 UTC m=+10.096719933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vdd8" (UniqueName: "kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8") pod "network-check-target-mvlhs" (UID: "aedbaca7-4f48-4a56-80f5-9d98e4db99ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:24.942378 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:24.942345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:24.942521 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.942484    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:24.942595 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:24.942542    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:28.942525504 +0000 UTC m=+10.198002722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:25.169106 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:25.169075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:25.169266 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:25.169220    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:25.169465 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:25.169447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:25.169548 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:25.169447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:25.169622 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:25.169557    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:25.169690 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:25.169629    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:27.166696 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:27.165979    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:27.166696 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:27.166103    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:27.166696 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:27.166456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:27.166696 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:27.166547    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:27.166696 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:27.166625    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:27.167404 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:27.166739    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:28.773566 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:28.773523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:28.774023 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.773712    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:28.774023 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.773775    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret podName:67ada2d4-7c84-4cd2-ade4-67ceac12ea6e nodeName:}" failed. No retries permitted until 2026-07-23 17:57:36.773758418 +0000 UTC m=+18.029235625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret") pod "global-pull-secret-syncer-hwfr9" (UID: "67ada2d4-7c84-4cd2-ade4-67ceac12ea6e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:28.873944 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:28.873901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:28.874097 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.874060    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:28.874097 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.874084    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:28.874097 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.874096    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4vdd8 for pod openshift-network-diagnostics/network-check-target-mvlhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:28.874260 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.874161    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8 podName:aedbaca7-4f48-4a56-80f5-9d98e4db99ba nodeName:}" failed. No retries permitted until 2026-07-23 17:57:36.874143326 +0000 UTC m=+18.129620549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vdd8" (UniqueName: "kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8") pod "network-check-target-mvlhs" (UID: "aedbaca7-4f48-4a56-80f5-9d98e4db99ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:28.974777 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:28.974738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:28.974950 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.974932    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:28.975032 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:28.974999    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:36.974980945 +0000 UTC m=+18.230458156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:29.166880 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:29.166848    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:29.167081 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:29.166894    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:29.167081 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:29.166952    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:29.167081 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:29.167046    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:29.167237 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:29.167148    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:29.167237 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:29.167221    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:31.169707 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:31.169660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:31.170226 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:31.169796    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:31.170226 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:31.170140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:31.170347 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:31.170235    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:31.170347 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:31.170285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:31.170452 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:31.170413    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:33.169777 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:33.169744    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:33.169777 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:33.169779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:33.170237 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:33.169785    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:33.170237 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:33.169852    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:33.170237 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:33.169987    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:33.170237 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:33.170078    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:35.166769 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:35.166731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:35.167186 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:35.166862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:35.167186 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:35.166877    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:35.167186 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:35.166937    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:35.167186 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:35.166957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:35.167186 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:35.167060    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:36.834849 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:36.834819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:36.835227 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:36.834930    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:36.835227 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:36.834974    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret podName:67ada2d4-7c84-4cd2-ade4-67ceac12ea6e nodeName:}" failed. No retries permitted until 2026-07-23 17:57:52.834962766 +0000 UTC m=+34.090439972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret") pod "global-pull-secret-syncer-hwfr9" (UID: "67ada2d4-7c84-4cd2-ade4-67ceac12ea6e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:36.935532 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:36.935501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:36.935688 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:36.935628    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:36.935688 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:36.935646    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:36.935688 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:36.935658    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4vdd8 for pod openshift-network-diagnostics/network-check-target-mvlhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:36.935816 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:36.935726    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8 podName:aedbaca7-4f48-4a56-80f5-9d98e4db99ba nodeName:}" failed. No retries permitted until 2026-07-23 17:57:52.935711207 +0000 UTC m=+34.191188411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vdd8" (UniqueName: "kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8") pod "network-check-target-mvlhs" (UID: "aedbaca7-4f48-4a56-80f5-9d98e4db99ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:37.035795 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:37.035768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:37.035953 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:37.035935    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:37.036015 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:37.035996    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:53.035980545 +0000 UTC m=+34.291457748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:37.166206 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:37.166125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:37.166206 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:37.166165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:37.166422 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:37.166129    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:37.166422 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:37.166291    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:37.166422 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:37.166336    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:37.166422 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:37.166377    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:39.166846 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:39.166809    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:39.167286 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:39.166899    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:39.167286 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:39.167037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:39.167286 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:39.167137    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:39.167286 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:39.167204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:39.167464 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:39.167319    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:41.167192 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.166815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:41.167192 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:41.167112    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:41.167994 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.167197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:41.167994 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:41.167313    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:41.167994 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.167360    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:41.167994 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:41.167418    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:41.342984 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.342950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk" event={"ID":"c868ef87-bfe0-4e3e-a396-9f0f4737c844","Type":"ContainerStarted","Data":"f2949ef8412242bbdc2f50843684de92e7a9648ce4305abcb08391d48645b0c5"}
Jul 23 17:57:41.344369 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.344341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4c6fs" event={"ID":"4830057f-27c4-41b5-aee8-4ca6993a9769","Type":"ContainerStarted","Data":"89aa2f300600002d05198d7ddbfea03871f35bda47065908a333e24ff4d0850d"}
Jul 23 17:57:41.345997 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.345968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dvb5v" event={"ID":"20fab13a-6be4-44ef-8bca-ea378ff7076c","Type":"ContainerStarted","Data":"b31580df74f6b4faf2746b04ef536843ecbf9605a626c1f5ebeb0c5f9851ee4b"}
Jul 23 17:57:41.347416 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.347391    2560 generic.go:356] "Generic (PLEG): container finished" podID="18dcd755-1801-4494-b4b9-f668a3f05872" containerID="6a07e40a9127994a654fabdfe116eb6c38d000d95b5b585087658c366afd30ae" exitCode=0
Jul 23 17:57:41.347518 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.347464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerDied","Data":"6a07e40a9127994a654fabdfe116eb6c38d000d95b5b585087658c366afd30ae"}
Jul 23 17:57:41.349170 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.349146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pjfjn" event={"ID":"4356b5d1-a41e-48d6-8337-a0fcd446e859","Type":"ContainerStarted","Data":"4d6a0337085bb903f4286c5824d2cbc126eaa0b4cd772f03e595259021168b3f"}
Jul 23 17:57:41.351569 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.351539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"3c78739945b3a96e7a752a9daa47b1d0e61327055073edb8011b48968d527c6e"}
Jul 23 17:57:41.351664 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.351629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"3446ef9a53dc54bc39a39a346cfde87ac122bfe0c5efea0bedee8a947104e4ec"}
Jul 23 17:57:41.353018 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.352980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fg5p8" event={"ID":"aa7f41bd-482d-4bd6-92c9-e2680f3d98a9","Type":"ContainerStarted","Data":"e1409146db2865f533393d574a06f3ee2b29c6604220bc9170f0cf9ec8d16e5e"}
Jul 23 17:57:41.354582 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.354556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fdp7m" event={"ID":"2839ba52-6b89-4e06-b157-a78f9ce39351","Type":"ContainerStarted","Data":"2cee8f900171d7e2d90735b7efdb6bd99845db722ec906dd9056aa072e8029c3"}
Jul 23 17:57:41.365196 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.365150    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-71.ec2.internal" podStartSLOduration=21.365135093 podStartE2EDuration="21.365135093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:24.331588817 +0000 UTC m=+5.587066044" watchObservedRunningTime="2026-07-23 17:57:41.365135093 +0000 UTC m=+22.620612319"
Jul 23 17:57:41.386648 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.386613    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4c6fs" podStartSLOduration=11.788887998 podStartE2EDuration="22.386600352s" totalImagesPullingTime="10.597712354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:41.365119291 +0000 UTC m=+22.620596521" watchObservedRunningTime="2026-07-23 17:57:41.386600352 +0000 UTC m=+22.642077577"
Jul 23 17:57:41.386766 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.386700    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fg5p8" podStartSLOduration=3.84788745 podStartE2EDuration="22.386694716s" totalImagesPullingTime="18.538807266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:41.386248345 +0000 UTC m=+22.641725572" watchObservedRunningTime="2026-07-23 17:57:41.386694716 +0000 UTC m=+22.642171932"
Jul 23 17:57:41.439344 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.439301    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dvb5v" podStartSLOduration=3.891662322 podStartE2EDuration="22.439285514s" totalImagesPullingTime="18.547623192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:41.410176491 +0000 UTC m=+22.665653718" watchObservedRunningTime="2026-07-23 17:57:41.439285514 +0000 UTC m=+22.694762739"
Jul 23 17:57:41.498081 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.498044    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fdp7m" podStartSLOduration=3.892518757 podStartE2EDuration="22.498029481s" totalImagesPullingTime="18.605510724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:41.475743727 +0000 UTC m=+22.731220953" watchObservedRunningTime="2026-07-23 17:57:41.498029481 +0000 UTC m=+22.753506707"
Jul 23 17:57:41.498374 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:41.498354    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pjfjn" podStartSLOduration=3.9500283720000002 podStartE2EDuration="22.498346959s" totalImagesPullingTime="18.548318587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:41.496361214 +0000 UTC m=+22.751838447" watchObservedRunningTime="2026-07-23 17:57:41.498346959 +0000 UTC m=+22.753824186"
Jul 23 17:57:42.360255 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:42.360218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"62cfe111799f99b062a07655ddcf84c6721888f3b2115b6a716dcb6686c69435"}
Jul 23 17:57:42.361095 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:42.360339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"e59709f67c374af11057adedec01188c16b65c7750d97972f18222458e5692f5"}
Jul 23 17:57:42.361095 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:42.360382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"fd28b04d9d6c175e3e6c8cb92fddd089da851a2cafc11c2b7168d4e419464c3b"}
Jul 23 17:57:42.361095 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:42.360423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"fa8f8c3997ae90ea38b2d1a221260f53382a996628e039ecc438dcce21e400f8"}
Jul 23 17:57:42.361867 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:42.361838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tnl2x" event={"ID":"ed776bb4-003c-4b69-a130-36e46e65ab94","Type":"ContainerStarted","Data":"c6f0bbe4128fe881e8842f3b714bc18ae8d458ebc6a40d9f7ffa374e7395f0cd"}
Jul 23 17:57:42.383906 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:42.383859    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tnl2x" podStartSLOduration=4.849193318 podStartE2EDuration="23.383845547s" totalImagesPullingTime="18.534652229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:42.383256748 +0000 UTC m=+23.638733973" watchObservedRunningTime="2026-07-23 17:57:42.383845547 +0000 UTC m=+23.639322812"
Jul 23 17:57:42.675575 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:42.675552    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 17:57:43.159016 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.158824    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T17:57:42.675570468Z","UUID":"e54252ee-af91-4ec8-80c4-9d3afd7f70df","Handler":null,"Name":"","Endpoint":""}
Jul 23 17:57:43.160480 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.160454    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 17:57:43.160608 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.160499    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 17:57:43.166948 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.166928    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:43.167068 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:43.167035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:43.167364 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.167348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:43.167472 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.167348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:43.167472 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:43.167446    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:43.167586 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:43.167509    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:43.243636 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.243611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:43.365189 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:43.365158    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk" event={"ID":"c868ef87-bfe0-4e3e-a396-9f0f4737c844","Type":"ContainerStarted","Data":"3ad09b54e54485f652f2a37632f6384dffcb1bb5ef00c47d1dfd1618a8b1df99"}
Jul 23 17:57:44.369320 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:44.369110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk" event={"ID":"c868ef87-bfe0-4e3e-a396-9f0f4737c844","Type":"ContainerStarted","Data":"93f0e35062d00b306c800c593c7554e0d1b72764d130987c8e65c432c23885e2"}
Jul 23 17:57:44.372139 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:44.372114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"6488e656202b61fb0ab2abc2c64c13bf34f6dbfafdec97bba8a152a26ad317b6"}
Jul 23 17:57:44.389347 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:44.389307    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbwnk" podStartSLOduration=4.250281632 podStartE2EDuration="25.389294265s" totalImagesPullingTime="21.139012633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:44.389113923 +0000 UTC m=+25.644591150" watchObservedRunningTime="2026-07-23 17:57:44.389294265 +0000 UTC m=+25.644771491"
Jul 23 17:57:45.166430 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:45.166400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:45.166616 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:45.166515    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:45.166616 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:45.166400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:45.166616 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:45.166547    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:45.166791 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:45.166656    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:45.166791 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:45.166739    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:45.664930 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:45.664898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:45.665917 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:45.665900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:46.377889 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:46.377706    2560 generic.go:356] "Generic (PLEG): container finished" podID="18dcd755-1801-4494-b4b9-f668a3f05872" containerID="37c2e7ec6a1787b1b4d2f67374c457c898202fa2c7f3bb941e068473fd88cb27" exitCode=0
Jul 23 17:57:46.378049 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:46.377779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerDied","Data":"37c2e7ec6a1787b1b4d2f67374c457c898202fa2c7f3bb941e068473fd88cb27"}
Jul 23 17:57:46.381699 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:46.381662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" event={"ID":"80f63878-70df-40dd-b8da-8d124ebe49c6","Type":"ContainerStarted","Data":"7c63e7322ea3cf22f9bb8cbf89220651f2294d2914430ce35aae1149ea5770e1"}
Jul 23 17:57:46.382376 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:46.382360    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4c6fs"
Jul 23 17:57:46.452617 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:46.452576    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5" podStartSLOduration=8.83735927 podStartE2EDuration="27.452560802s" totalImagesPullingTime="18.615201532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:46.450810302 +0000 UTC m=+27.706287527" watchObservedRunningTime="2026-07-23 17:57:46.452560802 +0000 UTC m=+27.708038028"
Jul 23 17:57:47.177657 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.175882    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:47.177657 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:47.176004    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:47.177657 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.176424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:47.177657 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:47.176514    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:47.177657 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.176836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:47.177657 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:47.176927    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:47.383860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.383823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:47.384009 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.383888    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:47.384009 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.383917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:47.398977 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.398952    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:47.399119 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:47.399083    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:57:48.388940 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.388900    2560 generic.go:356] "Generic (PLEG): container finished" podID="18dcd755-1801-4494-b4b9-f668a3f05872" containerID="cb6c1233d0fbeae2011f87cdf19c046a6dcfd73825b82b95a0db620106e32e38" exitCode=0
Jul 23 17:57:48.389540 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.388976    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerDied","Data":"cb6c1233d0fbeae2011f87cdf19c046a6dcfd73825b82b95a0db620106e32e38"}
Jul 23 17:57:48.411260 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.411236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwfr9"]
Jul 23 17:57:48.411359 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.411304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:48.411421 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:48.411375    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:48.413599 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.413580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvlhs"]
Jul 23 17:57:48.413684 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.413641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:48.413740 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:48.413725    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:48.416774 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.416756    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lxtj"]
Jul 23 17:57:48.416852 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:48.416818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:48.416894 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:48.416883    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:50.166667 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:50.166492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:50.167051 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:50.166492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:50.167051 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:50.166756    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:50.167051 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:50.166525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:50.167051 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:50.166837    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:50.167051 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:50.166879    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:50.395707 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:50.395659    2560 generic.go:356] "Generic (PLEG): container finished" podID="18dcd755-1801-4494-b4b9-f668a3f05872" containerID="1fd71f1ac6656284427af7955dfa9b6baa96f9a9faceec823b057f1ee0024a4f" exitCode=0
Jul 23 17:57:50.395862 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:50.395703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerDied","Data":"1fd71f1ac6656284427af7955dfa9b6baa96f9a9faceec823b057f1ee0024a4f"}
Jul 23 17:57:52.166296 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:52.166266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:52.166941 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:52.166267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:52.166941 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.166372    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:52.166941 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:52.166267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:52.166941 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.166439    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:52.166941 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.166511    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:52.860783 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:52.860750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:52.860947 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.860899    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:52.861003 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.860968    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret podName:67ada2d4-7c84-4cd2-ade4-67ceac12ea6e nodeName:}" failed. No retries permitted until 2026-07-23 17:58:24.860949585 +0000 UTC m=+66.116426809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret") pod "global-pull-secret-syncer-hwfr9" (UID: "67ada2d4-7c84-4cd2-ade4-67ceac12ea6e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:52.961143 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:52.961108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:52.961306 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.961288    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:52.961357 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.961314    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:52.961357 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.961327    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4vdd8 for pod openshift-network-diagnostics/network-check-target-mvlhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:52.961463 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:52.961378    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8 podName:aedbaca7-4f48-4a56-80f5-9d98e4db99ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:24.961363176 +0000 UTC m=+66.216840380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vdd8" (UniqueName: "kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8") pod "network-check-target-mvlhs" (UID: "aedbaca7-4f48-4a56-80f5-9d98e4db99ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:53.062194 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:53.062163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:53.062341 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:53.062309    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:53.062395 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:53.062359    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:25.062346057 +0000 UTC m=+66.317823265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:54.166112 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.166076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:54.166598 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.166076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:54.166598 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.166185    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lxtj" podUID="0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679"
Jul 23 17:57:54.166598 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.166301    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvlhs" podUID="aedbaca7-4f48-4a56-80f5-9d98e4db99ba"
Jul 23 17:57:54.166598 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.166093    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:54.166598 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.166412    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwfr9" podUID="67ada2d4-7c84-4cd2-ade4-67ceac12ea6e"
Jul 23 17:57:54.591870 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.591835    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-71.ec2.internal" event="NodeReady"
Jul 23 17:57:54.592045 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.591989    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 17:57:54.635513 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.635487    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85c848db4b-hcmjr"]
Jul 23 17:57:54.637899 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.637881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.641097 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.641072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 17:57:54.641202 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.641133    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lk5rs\""
Jul 23 17:57:54.641202 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.641083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 17:57:54.641649 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.641623    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 17:57:54.648400 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.648352    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 17:57:54.658482 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.658460    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5tdrn"]
Jul 23 17:57:54.660257 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.660241    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.663604 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.663584    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c848db4b-hcmjr"]
Jul 23 17:57:54.664250 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.664230    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 17:57:54.664345 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.664237    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 17:57:54.664345 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.664275    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djwnl\""
Jul 23 17:57:54.666046 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.666006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:54.668441 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.668421    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mz9qk"]
Jul 23 17:57:54.670008 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.669989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:54.672867 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.672850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xlctx\""
Jul 23 17:57:54.673097 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.673082    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 17:57:54.673184 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.673134    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 17:57:54.673401 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.673386    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 17:57:54.680475 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.680459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tdrn"]
Jul 23 17:57:54.682974 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.682952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mz9qk"]
Jul 23 17:57:54.776027 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.775956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c472ce-649d-461f-a266-3d130826682f-config-volume\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.776027 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.775987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc2qv\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-kube-api-access-rc2qv\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776027 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2a5deb7-db60-4411-b869-163ef08ea9b0-cert\") pod \"ingress-canary-mz9qk\" (UID: \"d2a5deb7-db60-4411-b869-163ef08ea9b0\") " pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:54.776271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-image-registry-private-configuration\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-certificates\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-bound-sa-token\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fb90b05-f9b1-409f-890e-111bd50340a8-ca-trust-extracted\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-installation-pull-secrets\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776271 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c472ce-649d-461f-a266-3d130826682f-tmp-dir\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.776524 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-trusted-ca\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776524 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktx2p\" (UniqueName: \"kubernetes.io/projected/b9c472ce-649d-461f-a266-3d130826682f-kube-api-access-ktx2p\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.776524 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.776524 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4pml\" (UniqueName: \"kubernetes.io/projected/d2a5deb7-db60-4411-b869-163ef08ea9b0-kube-api-access-v4pml\") pod \"ingress-canary-mz9qk\" (UID: \"d2a5deb7-db60-4411-b869-163ef08ea9b0\") " pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:54.776524 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.776447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.811276 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.811244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:54.877298 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.877467 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c472ce-649d-461f-a266-3d130826682f-config-volume\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.877467 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc2qv\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-kube-api-access-rc2qv\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877467 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2a5deb7-db60-4411-b869-163ef08ea9b0-cert\") pod \"ingress-canary-mz9qk\" (UID: \"d2a5deb7-db60-4411-b869-163ef08ea9b0\") " pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:54.877629 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-image-registry-private-configuration\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877629 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-certificates\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877629 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-bound-sa-token\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877629 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fb90b05-f9b1-409f-890e-111bd50340a8-ca-trust-extracted\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877851 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-installation-pull-secrets\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877851 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c472ce-649d-461f-a266-3d130826682f-tmp-dir\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.877851 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-trusted-ca\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877997 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktx2p\" (UniqueName: \"kubernetes.io/projected/b9c472ce-649d-461f-a266-3d130826682f-kube-api-access-ktx2p\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.877997 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.877997 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4pml\" (UniqueName: \"kubernetes.io/projected/d2a5deb7-db60-4411-b869-163ef08ea9b0-kube-api-access-v4pml\") pod \"ingress-canary-mz9qk\" (UID: \"d2a5deb7-db60-4411-b869-163ef08ea9b0\") " pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:54.877997 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.877954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fb90b05-f9b1-409f-890e-111bd50340a8-ca-trust-extracted\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.878180 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.878000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c472ce-649d-461f-a266-3d130826682f-config-volume\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.878180 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.878071    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:57:54.878180 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.878120    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls podName:b9c472ce-649d-461f-a266-3d130826682f nodeName:}" failed. No retries permitted until 2026-07-23 17:57:55.378107497 +0000 UTC m=+36.633584700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls") pod "dns-default-5tdrn" (UID: "b9c472ce-649d-461f-a266-3d130826682f") : secret "dns-default-metrics-tls" not found
Jul 23 17:57:54.878180 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.878123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-certificates\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.878370 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.878214    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:57:54.878370 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.878227    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c848db4b-hcmjr: secret "image-registry-tls" not found
Jul 23 17:57:54.878370 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:54.878272    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls podName:7fb90b05-f9b1-409f-890e-111bd50340a8 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:55.378256331 +0000 UTC m=+36.633733557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls") pod "image-registry-85c848db4b-hcmjr" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8") : secret "image-registry-tls" not found
Jul 23 17:57:54.878525 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.878458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c472ce-649d-461f-a266-3d130826682f-tmp-dir\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.879094 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.879070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-trusted-ca\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.882810 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.882787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-installation-pull-secrets\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.882810 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.882802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2a5deb7-db60-4411-b869-163ef08ea9b0-cert\") pod \"ingress-canary-mz9qk\" (UID: \"d2a5deb7-db60-4411-b869-163ef08ea9b0\") " pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:54.882964 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.882790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-image-registry-private-configuration\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.888631 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.888606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc2qv\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-kube-api-access-rc2qv\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.891360 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.891341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4pml\" (UniqueName: \"kubernetes.io/projected/d2a5deb7-db60-4411-b869-163ef08ea9b0-kube-api-access-v4pml\") pod \"ingress-canary-mz9qk\" (UID: \"d2a5deb7-db60-4411-b869-163ef08ea9b0\") " pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:54.897511 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.897491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-bound-sa-token\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:54.897621 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.897520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktx2p\" (UniqueName: \"kubernetes.io/projected/b9c472ce-649d-461f-a266-3d130826682f-kube-api-access-ktx2p\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:54.920750 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.920720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:54.979148 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:54.979123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mz9qk"
Jul 23 17:57:55.246055 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.245826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mz9qk"]
Jul 23 17:57:55.250309 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:57:55.250284    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a5deb7_db60_4411_b869_163ef08ea9b0.slice/crio-c9e806e5e96556daf390c77020e08b4ea15a4e968299f5951d5b9ee44d360eaf WatchSource:0}: Error finding container c9e806e5e96556daf390c77020e08b4ea15a4e968299f5951d5b9ee44d360eaf: Status 404 returned error can't find the container with id c9e806e5e96556daf390c77020e08b4ea15a4e968299f5951d5b9ee44d360eaf
Jul 23 17:57:55.382261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.382182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:55.382261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.382240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:55.382378 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:55.382335    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:57:55.382378 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:55.382341    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:57:55.382443 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:55.382400    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls podName:b9c472ce-649d-461f-a266-3d130826682f nodeName:}" failed. No retries permitted until 2026-07-23 17:57:56.382384191 +0000 UTC m=+37.637861396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls") pod "dns-default-5tdrn" (UID: "b9c472ce-649d-461f-a266-3d130826682f") : secret "dns-default-metrics-tls" not found
Jul 23 17:57:55.382443 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:55.382345    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c848db4b-hcmjr: secret "image-registry-tls" not found
Jul 23 17:57:55.382509 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:55.382475    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls podName:7fb90b05-f9b1-409f-890e-111bd50340a8 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:56.382464197 +0000 UTC m=+37.637941401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls") pod "image-registry-85c848db4b-hcmjr" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8") : secret "image-registry-tls" not found
Jul 23 17:57:55.409729 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.409703    2560 generic.go:356] "Generic (PLEG): container finished" podID="18dcd755-1801-4494-b4b9-f668a3f05872" containerID="0c63887d4245c0ab83e01004c0eb0fb63ac6578e3ccc4a6b85aea07129a4c858" exitCode=0
Jul 23 17:57:55.409831 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.409760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerDied","Data":"0c63887d4245c0ab83e01004c0eb0fb63ac6578e3ccc4a6b85aea07129a4c858"}
Jul 23 17:57:55.410899 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.410882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mz9qk" event={"ID":"d2a5deb7-db60-4411-b869-163ef08ea9b0","Type":"ContainerStarted","Data":"c9e806e5e96556daf390c77020e08b4ea15a4e968299f5951d5b9ee44d360eaf"}
Jul 23 17:57:55.564014 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.563985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:55.633926 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:55.633869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:56.166167 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.166132    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:57:56.166332 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.166139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:57:56.166390 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.166139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:57:56.169800 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.169778    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qd4dg\""
Jul 23 17:57:56.169800 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.169790    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdhp\""
Jul 23 17:57:56.169966 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.169859    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 17:57:56.170023 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.170007    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 17:57:56.170099 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.170083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 17:57:56.170198 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.170181    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 17:57:56.390987 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.390956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:56.391314 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.391013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:56.391314 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:56.391105    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:57:56.391314 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:56.391120    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c848db4b-hcmjr: secret "image-registry-tls" not found
Jul 23 17:57:56.391314 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:56.391124    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:57:56.391314 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:56.391180    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls podName:7fb90b05-f9b1-409f-890e-111bd50340a8 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:58.391166621 +0000 UTC m=+39.646643829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls") pod "image-registry-85c848db4b-hcmjr" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8") : secret "image-registry-tls" not found
Jul 23 17:57:56.391314 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:56.391195    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls podName:b9c472ce-649d-461f-a266-3d130826682f nodeName:}" failed. No retries permitted until 2026-07-23 17:57:58.391189481 +0000 UTC m=+39.646666685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls") pod "dns-default-5tdrn" (UID: "b9c472ce-649d-461f-a266-3d130826682f") : secret "dns-default-metrics-tls" not found
Jul 23 17:57:56.415507 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.415482    2560 generic.go:356] "Generic (PLEG): container finished" podID="18dcd755-1801-4494-b4b9-f668a3f05872" containerID="7ed61dcb80da67b0a28fbea78787da1b88fa1eb0c9a6c9b21c2497b92e01cbb7" exitCode=0
Jul 23 17:57:56.415612 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:56.415525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerDied","Data":"7ed61dcb80da67b0a28fbea78787da1b88fa1eb0c9a6c9b21c2497b92e01cbb7"}
Jul 23 17:57:57.421732 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:57.421559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" event={"ID":"18dcd755-1801-4494-b4b9-f668a3f05872","Type":"ContainerStarted","Data":"2633efb50264bb20c6d1595c8dad810c4b5ecdad5f62be049226dc62518ca9ea"}
Jul 23 17:57:57.448968 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:57.448930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lfrd9" podStartSLOduration=8.140713931 podStartE2EDuration="38.448912132s" totalImagesPullingTime="30.308198201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:57.448499178 +0000 UTC m=+38.703976431" watchObservedRunningTime="2026-07-23 17:57:57.448912132 +0000 UTC m=+38.704389361"
Jul 23 17:57:57.570918 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:57.570885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:57.646116 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:57.646082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:58.390391 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:58.390353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:57:58.408510 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:58.408482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:57:58.408637 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:58.408536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:57:58.408637 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:58.408617    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:57:58.408637 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:58.408627    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c848db4b-hcmjr: secret "image-registry-tls" not found
Jul 23 17:57:58.408764 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:58.408687    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls podName:7fb90b05-f9b1-409f-890e-111bd50340a8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:02.408656289 +0000 UTC m=+43.664133492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls") pod "image-registry-85c848db4b-hcmjr" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8") : secret "image-registry-tls" not found
Jul 23 17:57:58.408764 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:58.408616    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:57:58.408764 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:57:58.408718    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls podName:b9c472ce-649d-461f-a266-3d130826682f nodeName:}" failed. No retries permitted until 2026-07-23 17:58:02.408711466 +0000 UTC m=+43.664188670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls") pod "dns-default-5tdrn" (UID: "b9c472ce-649d-461f-a266-3d130826682f") : secret "dns-default-metrics-tls" not found
Jul 23 17:57:58.424733 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:58.424707    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mz9qk" event={"ID":"d2a5deb7-db60-4411-b869-163ef08ea9b0","Type":"ContainerStarted","Data":"9e0d4a80e798a7afb0ca249e2017ded4a930352748fcadb992fa43d29fc4dde0"}
Jul 23 17:57:58.450274 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:58.450200    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mz9qk" podStartSLOduration=1.54940625 podStartE2EDuration="4.450186168s" totalImagesPullingTime="2.900779918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:57:58.449812237 +0000 UTC m=+39.705289464" watchObservedRunningTime="2026-07-23 17:57:58.450186168 +0000 UTC m=+39.705663393"
Jul 23 17:57:58.491338 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:57:58.491285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:00.575824 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:00.575768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:02.333209 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:02.333172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:02.437023 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:02.436995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:58:02.437150 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:02.437046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:58:02.437150 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:02.437138    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:02.437242 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:02.437155    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c848db4b-hcmjr: secret "image-registry-tls" not found
Jul 23 17:58:02.437242 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:02.437203    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls podName:7fb90b05-f9b1-409f-890e-111bd50340a8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:10.437188743 +0000 UTC m=+51.692665947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls") pod "image-registry-85c848db4b-hcmjr" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8") : secret "image-registry-tls" not found
Jul 23 17:58:02.437242 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:02.437141    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:02.437339 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:02.437265    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls podName:b9c472ce-649d-461f-a266-3d130826682f nodeName:}" failed. No retries permitted until 2026-07-23 17:58:10.437251563 +0000 UTC m=+51.692728766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls") pod "dns-default-5tdrn" (UID: "b9c472ce-649d-461f-a266-3d130826682f") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:02.495352 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:02.495329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:03.267728 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:03.267693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:03.387234 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:03.387199    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:04.163641 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:04.163607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:05.148326 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:05.148289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:05.260571 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:05.260541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:07.267766 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:07.267734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:07.415924 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:07.415893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:10.347966 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:10.347935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:10.427552 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:10.427523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:10.510158 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:10.510126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:58:10.510293 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:10.510187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:58:10.510293 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:10.510267    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:10.510369 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:10.510321    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls podName:b9c472ce-649d-461f-a266-3d130826682f nodeName:}" failed. No retries permitted until 2026-07-23 17:58:26.510306946 +0000 UTC m=+67.765784150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls") pod "dns-default-5tdrn" (UID: "b9c472ce-649d-461f-a266-3d130826682f") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:10.510369 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:10.510270    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:10.510369 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:10.510367    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c848db4b-hcmjr: secret "image-registry-tls" not found
Jul 23 17:58:10.510474 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:10.510420    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls podName:7fb90b05-f9b1-409f-890e-111bd50340a8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:26.510409364 +0000 UTC m=+67.765886568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls") pod "image-registry-85c848db4b-hcmjr" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8") : secret "image-registry-tls" not found
Jul 23 17:58:10.558406 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:10.558369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:10.626978 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:10.626900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:10.699167 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:10.699138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:14.207985 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:14.207945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:18.326531 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:18.326490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:18.435740 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:18.435711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:18.535492 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:18.535465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:19.400895 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:19.400868    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4d9v5"
Jul 23 17:58:19.568161 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:19.568129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:20.767470 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:20.767433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:24.901788 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:24.901741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:58:24.904916 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:24.904894    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 17:58:24.915782 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:24.915756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67ada2d4-7c84-4cd2-ade4-67ceac12ea6e-original-pull-secret\") pod \"global-pull-secret-syncer-hwfr9\" (UID: \"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e\") " pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:58:24.986274 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:24.986243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwfr9"
Jul 23 17:58:25.002034 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.002015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:58:25.004921 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.004901    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 17:58:25.015746 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.015719    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 17:58:25.025594 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.025571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vdd8\" (UniqueName: \"kubernetes.io/projected/aedbaca7-4f48-4a56-80f5-9d98e4db99ba-kube-api-access-4vdd8\") pod \"network-check-target-mvlhs\" (UID: \"aedbaca7-4f48-4a56-80f5-9d98e4db99ba\") " pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:58:25.102359 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.102320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:58:25.104991 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.104947    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwfr9"]
Jul 23 17:58:25.105593 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.105571    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 17:58:25.108710 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:58:25.108665    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ada2d4_7c84_4cd2_ade4_67ceac12ea6e.slice/crio-880c5007b8e79bca4d84c857644ae9faa4dd90576fa09cd8c56670365005d824 WatchSource:0}: Error finding container 880c5007b8e79bca4d84c857644ae9faa4dd90576fa09cd8c56670365005d824: Status 404 returned error can't find the container with id 880c5007b8e79bca4d84c857644ae9faa4dd90576fa09cd8c56670365005d824
Jul 23 17:58:25.112921 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:25.112899    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 17:58:25.113000 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:25.112977    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs podName:0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679 nodeName:}" failed. No retries permitted until 2026-07-23 17:59:29.112955119 +0000 UTC m=+130.368432341 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs") pod "network-metrics-daemon-7lxtj" (UID: "0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679") : secret "metrics-daemon-secret" not found
Jul 23 17:58:25.278736 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.278658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qd4dg\""
Jul 23 17:58:25.287012 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.286984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:58:25.404470 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.404444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvlhs"]
Jul 23 17:58:25.407111 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:58:25.407089    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedbaca7_4f48_4a56_80f5_9d98e4db99ba.slice/crio-c9cef3707f99e333c0e1f008cfd21a10b5e42d28796656157a8804a9476daa15 WatchSource:0}: Error finding container c9cef3707f99e333c0e1f008cfd21a10b5e42d28796656157a8804a9476daa15: Status 404 returned error can't find the container with id c9cef3707f99e333c0e1f008cfd21a10b5e42d28796656157a8804a9476daa15
Jul 23 17:58:25.480955 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.480928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvlhs" event={"ID":"aedbaca7-4f48-4a56-80f5-9d98e4db99ba","Type":"ContainerStarted","Data":"c9cef3707f99e333c0e1f008cfd21a10b5e42d28796656157a8804a9476daa15"}
Jul 23 17:58:25.481899 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:25.481879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwfr9" event={"ID":"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e","Type":"ContainerStarted","Data":"880c5007b8e79bca4d84c857644ae9faa4dd90576fa09cd8c56670365005d824"}
Jul 23 17:58:26.514647 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:26.514377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:58:26.514647 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:26.514441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:58:26.514647 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:26.514544    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:26.514647 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:26.514544    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:26.514647 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:26.514570    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85c848db4b-hcmjr: secret "image-registry-tls" not found
Jul 23 17:58:26.514647 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:26.514606    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls podName:b9c472ce-649d-461f-a266-3d130826682f nodeName:}" failed. No retries permitted until 2026-07-23 17:58:58.514587692 +0000 UTC m=+99.770064910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls") pod "dns-default-5tdrn" (UID: "b9c472ce-649d-461f-a266-3d130826682f") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:26.514647 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:26.514625    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls podName:7fb90b05-f9b1-409f-890e-111bd50340a8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:58.514615786 +0000 UTC m=+99.770092991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls") pod "image-registry-85c848db4b-hcmjr" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8") : secret "image-registry-tls" not found
Jul 23 17:58:30.494979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:30.494941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvlhs" event={"ID":"aedbaca7-4f48-4a56-80f5-9d98e4db99ba","Type":"ContainerStarted","Data":"514a446a13b284fee5a34bd75485384439b26ee627f856366028a91d59eb6ec0"}
Jul 23 17:58:30.495420 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:30.495062    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:58:30.496392 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:30.496371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwfr9" event={"ID":"67ada2d4-7c84-4cd2-ade4-67ceac12ea6e","Type":"ContainerStarted","Data":"b325746e02b876fe703af828998e8dd427a97cc56eb0668ef63615e3db5fcfcf"}
Jul 23 17:58:30.518223 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:30.518181    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mvlhs" podStartSLOduration=66.967014852 podStartE2EDuration="1m11.518170013s" totalImagesPullingTime="4.551155161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:30.517175988 +0000 UTC m=+71.772653214" watchObservedRunningTime="2026-07-23 17:58:30.518170013 +0000 UTC m=+71.773647238"
Jul 23 17:58:30.534375 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:30.534333    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hwfr9" podStartSLOduration=66.680638234 podStartE2EDuration="1m11.534319425s" totalImagesPullingTime="4.853681191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:30.533662973 +0000 UTC m=+71.789140219" watchObservedRunningTime="2026-07-23 17:58:30.534319425 +0000 UTC m=+71.789796650"
Jul 23 17:58:32.535072 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:32.535032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:32.603204 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:32.603183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:40.320211 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:40.320163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:40.422067 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:40.422033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:41.894127 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.894021    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"]
Jul 23 17:58:41.896709 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.896686    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hstvn"]
Jul 23 17:58:41.896821 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.896777    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:41.898355 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.898330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:41.899437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.899420    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 17:58:41.899748 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.899732    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 17:58:41.899807 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.899749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5flqq\""
Jul 23 17:58:41.899898 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.899882    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 17:58:41.900846 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.900832    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 17:58:41.902420 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.902404    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6w2hn\""
Jul 23 17:58:41.902420 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.902407    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 17:58:41.902652 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.902639    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 17:58:41.903927 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.903908    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 17:58:41.907076 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.907058    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 17:58:41.910118 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.910101    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"]
Jul 23 17:58:41.911192 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:41.911167    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hstvn"]
Jul 23 17:58:42.020486 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.020459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxgj5\" (UniqueName: \"kubernetes.io/projected/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-kube-api-access-wxgj5\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.020596 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.020491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z9t6\" (UniqueName: \"kubernetes.io/projected/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-kube-api-access-9z9t6\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:42.020596 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.020515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-serving-cert\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.020596 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.020557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-trusted-ca\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.020740 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.020613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-config\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.020740 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.020649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:42.056084 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.056060    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:42.121662 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.121642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:42.121748 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.121688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxgj5\" (UniqueName: \"kubernetes.io/projected/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-kube-api-access-wxgj5\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.121748 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.121707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z9t6\" (UniqueName: \"kubernetes.io/projected/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-kube-api-access-9z9t6\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:42.121748 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.121743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-serving-cert\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.121849 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.121767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-trusted-ca\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.121849 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:42.121780    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 17:58:42.121849 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:42.121837    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls podName:db2cd433-c8f7-4ead-a116-a43ff78f0b6d nodeName:}" failed. No retries permitted until 2026-07-23 17:58:42.621819555 +0000 UTC m=+83.877296759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-s9k99" (UID: "db2cd433-c8f7-4ead-a116-a43ff78f0b6d") : secret "samples-operator-tls" not found
Jul 23 17:58:42.121946 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.121869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-config\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.122472 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.122456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-config\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.122603 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.122586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-trusted-ca\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.123985 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.123970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-serving-cert\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.132098 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.132072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z9t6\" (UniqueName: \"kubernetes.io/projected/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-kube-api-access-9z9t6\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:42.132548 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.132531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxgj5\" (UniqueName: \"kubernetes.io/projected/fab3b010-3e1e-4332-a3bf-5c21a3c68a7c-kube-api-access-wxgj5\") pod \"console-operator-565b7b569d-hstvn\" (UID: \"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c\") " pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.156533 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.156484    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:42.212753 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.212733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:42.333612 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.333579    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hstvn"]
Jul 23 17:58:42.336123 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:58:42.336094    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab3b010_3e1e_4332_a3bf_5c21a3c68a7c.slice/crio-19bbd24fd0a50b3b52cb1c6f8a2092d358d2d52815e069f4065bfe42528e75fc WatchSource:0}: Error finding container 19bbd24fd0a50b3b52cb1c6f8a2092d358d2d52815e069f4065bfe42528e75fc: Status 404 returned error can't find the container with id 19bbd24fd0a50b3b52cb1c6f8a2092d358d2d52815e069f4065bfe42528e75fc
Jul 23 17:58:42.526715 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.526652    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" event={"ID":"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c","Type":"ContainerStarted","Data":"19bbd24fd0a50b3b52cb1c6f8a2092d358d2d52815e069f4065bfe42528e75fc"}
Jul 23 17:58:42.625449 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:42.625426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:42.625584 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:42.625568    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 17:58:42.625645 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:42.625636    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls podName:db2cd433-c8f7-4ead-a116-a43ff78f0b6d nodeName:}" failed. No retries permitted until 2026-07-23 17:58:43.625619793 +0000 UTC m=+84.881096996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-s9k99" (UID: "db2cd433-c8f7-4ead-a116-a43ff78f0b6d") : secret "samples-operator-tls" not found
Jul 23 17:58:43.633125 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:43.633085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:43.633497 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:43.633212    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 17:58:43.633497 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:43.633267    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls podName:db2cd433-c8f7-4ead-a116-a43ff78f0b6d nodeName:}" failed. No retries permitted until 2026-07-23 17:58:45.633249888 +0000 UTC m=+86.888727093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-s9k99" (UID: "db2cd433-c8f7-4ead-a116-a43ff78f0b6d") : secret "samples-operator-tls" not found
Jul 23 17:58:44.674369 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:44.674338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:44.780867 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:44.780833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:45.535489 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:45.535462    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/0.log"
Jul 23 17:58:45.535686 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:45.535501    2560 generic.go:356] "Generic (PLEG): container finished" podID="fab3b010-3e1e-4332-a3bf-5c21a3c68a7c" containerID="578ea63f804c82e3e118e45c7b78039a7b1d0e52b7c9efd02190b94be9d6cd35" exitCode=255
Jul 23 17:58:45.535686 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:45.535534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" event={"ID":"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c","Type":"ContainerDied","Data":"578ea63f804c82e3e118e45c7b78039a7b1d0e52b7c9efd02190b94be9d6cd35"}
Jul 23 17:58:45.535817 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:45.535802    2560 scope.go:117] "RemoveContainer" containerID="578ea63f804c82e3e118e45c7b78039a7b1d0e52b7c9efd02190b94be9d6cd35"
Jul 23 17:58:45.650574 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:45.650547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:45.650695 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:45.650652    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 17:58:45.650757 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:45.650731    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls podName:db2cd433-c8f7-4ead-a116-a43ff78f0b6d nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.650713356 +0000 UTC m=+90.906190575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-s9k99" (UID: "db2cd433-c8f7-4ead-a116-a43ff78f0b6d") : secret "samples-operator-tls" not found
Jul 23 17:58:45.942073 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:45.942007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:46.099043 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.099015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:46.539020 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.538998    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 17:58:46.539419 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.539401    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/0.log"
Jul 23 17:58:46.539532 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.539440    2560 generic.go:356] "Generic (PLEG): container finished" podID="fab3b010-3e1e-4332-a3bf-5c21a3c68a7c" containerID="400c4619a38e7a92e4dac6bbfb92ef43fdc47d9bca12ce5065a2ecd420e7b64b" exitCode=255
Jul 23 17:58:46.539532 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.539480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" event={"ID":"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c","Type":"ContainerDied","Data":"400c4619a38e7a92e4dac6bbfb92ef43fdc47d9bca12ce5065a2ecd420e7b64b"}
Jul 23 17:58:46.539643 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.539536    2560 scope.go:117] "RemoveContainer" containerID="578ea63f804c82e3e118e45c7b78039a7b1d0e52b7c9efd02190b94be9d6cd35"
Jul 23 17:58:46.539734 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.539715    2560 scope.go:117] "RemoveContainer" containerID="400c4619a38e7a92e4dac6bbfb92ef43fdc47d9bca12ce5065a2ecd420e7b64b"
Jul 23 17:58:46.539877 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:46.539856    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hstvn_openshift-console-operator(fab3b010-3e1e-4332-a3bf-5c21a3c68a7c)\"" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" podUID="fab3b010-3e1e-4332-a3bf-5c21a3c68a7c"
Jul 23 17:58:46.887303 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.887235    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"]
Jul 23 17:58:46.891198 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.891181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"
Jul 23 17:58:46.897041 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.897021    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 17:58:46.897145 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.897069    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 17:58:46.897145 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.897080    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-24rds\""
Jul 23 17:58:46.908152 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.908133    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"]
Jul 23 17:58:46.959603 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:46.959573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjmbp\" (UniqueName: \"kubernetes.io/projected/02f3d940-5847-4bbe-88f6-1894e8d1b475-kube-api-access-bjmbp\") pod \"migrator-7cc9c7ffd7-fgvrh\" (UID: \"02f3d940-5847-4bbe-88f6-1894e8d1b475\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"
Jul 23 17:58:47.018915 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.018892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:47.060142 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.060124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjmbp\" (UniqueName: \"kubernetes.io/projected/02f3d940-5847-4bbe-88f6-1894e8d1b475-kube-api-access-bjmbp\") pod \"migrator-7cc9c7ffd7-fgvrh\" (UID: \"02f3d940-5847-4bbe-88f6-1894e8d1b475\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"
Jul 23 17:58:47.078583 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.078564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjmbp\" (UniqueName: \"kubernetes.io/projected/02f3d940-5847-4bbe-88f6-1894e8d1b475-kube-api-access-bjmbp\") pod \"migrator-7cc9c7ffd7-fgvrh\" (UID: \"02f3d940-5847-4bbe-88f6-1894e8d1b475\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"
Jul 23 17:58:47.198944 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.198896    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"
Jul 23 17:58:47.304422 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.304397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:47.343195 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.343170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh"]
Jul 23 17:58:47.351846 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:58:47.351826    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f3d940_5847_4bbe_88f6_1894e8d1b475.slice/crio-078fa98849cc6774bcccce087d5bfad6cafcb535d9ec5bee50b6558e7321b403 WatchSource:0}: Error finding container 078fa98849cc6774bcccce087d5bfad6cafcb535d9ec5bee50b6558e7321b403: Status 404 returned error can't find the container with id 078fa98849cc6774bcccce087d5bfad6cafcb535d9ec5bee50b6558e7321b403
Jul 23 17:58:47.450485 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.450419    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hswxc"]
Jul 23 17:58:47.454825 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.454806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.464447 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:47.464421    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-hswxc\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" podUID="846c558b-787c-491f-b363-7b006b0471ba" pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.464560 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:47.464538    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-dj9xd\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dj9xd\"" type="*v1.Secret"
Jul 23 17:58:47.464665 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:47.464529    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 23 17:58:47.464665 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:47.464539    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 23 17:58:47.464665 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:47.464604    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 23 17:58:47.464665 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:47.464646    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Jul 23 17:58:47.485611 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.485590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hswxc"]
Jul 23 17:58:47.543326 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.543302    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 17:58:47.543616 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.543600    2560 scope.go:117] "RemoveContainer" containerID="400c4619a38e7a92e4dac6bbfb92ef43fdc47d9bca12ce5065a2ecd420e7b64b"
Jul 23 17:58:47.543809 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:47.543785    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hstvn_openshift-console-operator(fab3b010-3e1e-4332-a3bf-5c21a3c68a7c)\"" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" podUID="fab3b010-3e1e-4332-a3bf-5c21a3c68a7c"
Jul 23 17:58:47.544501 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.544482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh" event={"ID":"02f3d940-5847-4bbe-88f6-1894e8d1b475","Type":"ContainerStarted","Data":"078fa98849cc6774bcccce087d5bfad6cafcb535d9ec5bee50b6558e7321b403"}
Jul 23 17:58:47.564717 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.564698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/846c558b-787c-491f-b363-7b006b0471ba-crio-socket\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.564793 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.564752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjklz\" (UniqueName: \"kubernetes.io/projected/846c558b-787c-491f-b363-7b006b0471ba-kube-api-access-cjklz\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.564793 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.564775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.564873 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.564807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.564873 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.564841    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/846c558b-787c-491f-b363-7b006b0471ba-data-volume\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.613208 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.613184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:47.665314 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.665291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.665409 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.665320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/846c558b-787c-491f-b363-7b006b0471ba-data-volume\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.665409 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.665353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/846c558b-787c-491f-b363-7b006b0471ba-crio-socket\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.665495 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.665410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/846c558b-787c-491f-b363-7b006b0471ba-crio-socket\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.665539 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.665525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjklz\" (UniqueName: \"kubernetes.io/projected/846c558b-787c-491f-b363-7b006b0471ba-kube-api-access-cjklz\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.665602 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.665588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.665757 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.665729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/846c558b-787c-491f-b363-7b006b0471ba-data-volume\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:47.781506 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:47.781439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:48.259870 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:48.259835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:48.355709 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:48.355664    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 17:58:48.410998 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:48.410971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:48.545303 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:48.545270    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dj9xd\""
Jul 23 17:58:48.666513 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:48.666490    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition
Jul 23 17:58:48.666617 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:48.666569    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.166548124 +0000 UTC m=+90.422025329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : failed to sync configmap cache: timed out waiting for the condition
Jul 23 17:58:48.666617 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:48.666490    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition
Jul 23 17:58:48.666772 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:48.666641    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.166625374 +0000 UTC m=+90.422102578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : failed to sync secret cache: timed out waiting for the condition
Jul 23 17:58:48.702582 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:48.702562    2560 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 23 17:58:48.702703 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:48.702592    2560 projected.go:196] Error preparing data for projected volume kube-api-access-cjklz for pod openshift-insights/insights-runtime-extractor-hswxc: failed to sync configmap cache: timed out waiting for the condition
Jul 23 17:58:48.702703 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:48.702642    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846c558b-787c-491f-b363-7b006b0471ba-kube-api-access-cjklz podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.202627101 +0000 UTC m=+90.458104306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cjklz" (UniqueName: "kubernetes.io/projected/846c558b-787c-491f-b363-7b006b0471ba-kube-api-access-cjklz") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : failed to sync configmap cache: timed out waiting for the condition
Jul 23 17:58:48.703633 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:48.703611    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 17:58:48.875362 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:48.875340    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 17:58:48.975181 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:48.975159    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 17:58:49.178311 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.178235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:49.178311 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.178270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:49.178478 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:49.178351    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:49.178478 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:49.178362    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:49.178478 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:49.178407    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:50.178391888 +0000 UTC m=+91.433869107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:49.178478 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:49.178420    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:50.178414854 +0000 UTC m=+91.433892057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:49.279537 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.279508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjklz\" (UniqueName: \"kubernetes.io/projected/846c558b-787c-491f-b363-7b006b0471ba-kube-api-access-cjklz\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:49.281835 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.281806    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjklz\" (UniqueName: \"kubernetes.io/projected/846c558b-787c-491f-b363-7b006b0471ba-kube-api-access-cjklz\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:49.551150 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.551109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh" event={"ID":"02f3d940-5847-4bbe-88f6-1894e8d1b475","Type":"ContainerStarted","Data":"46e8fdd72864847cf1bea2e7283417898d0e09083e5a1d9df8fd13a045a15691"}
Jul 23 17:58:49.551304 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.551171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh" event={"ID":"02f3d940-5847-4bbe-88f6-1894e8d1b475","Type":"ContainerStarted","Data":"0746354e803da411562daddf1a4d52137f7de382f00dc7857e67add4ad8f0738"}
Jul 23 17:58:49.573819 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.573773    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fgvrh" podStartSLOduration=2.398710933 podStartE2EDuration="3.573754616s" totalImagesPullingTime="1.175043683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:49.573637274 +0000 UTC m=+90.829114504" watchObservedRunningTime="2026-07-23 17:58:49.573754616 +0000 UTC m=+90.829231843"
Jul 23 17:58:49.678212 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.678183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:49.683058 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.683038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:49.683216 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:49.683199    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 17:58:49.683272 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:49.683262    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls podName:db2cd433-c8f7-4ead-a116-a43ff78f0b6d nodeName:}" failed. No retries permitted until 2026-07-23 17:58:57.683246446 +0000 UTC m=+98.938723667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-s9k99" (UID: "db2cd433-c8f7-4ead-a116-a43ff78f0b6d") : secret "samples-operator-tls" not found
Jul 23 17:58:49.781571 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.781535    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:49.850872 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:49.850801    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:50.048563 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:50.048540    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fg5p8_aa7f41bd-482d-4bd6-92c9-e2680f3d98a9/dns-node-resolver/0.log"
Jul 23 17:58:50.187892 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:50.187819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:50.187892 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:50.187858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:50.188095 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:50.187976    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:50.188095 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:50.188034    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:52.188015578 +0000 UTC m=+93.443492795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:50.188095 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:50.188040    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:50.188095 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:50.188074    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:52.188064117 +0000 UTC m=+93.443541320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:51.158056 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:51.158023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:51.244116 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:51.244091    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pjfjn_4356b5d1-a41e-48d6-8337-a0fcd446e859/node-ca/0.log"
Jul 23 17:58:52.202074 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.202041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:52.202464 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.202079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:52.202464 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:52.202183    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:52.202464 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:52.202185    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:52.202464 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:52.202233    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:56.20222098 +0000 UTC m=+97.457698184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:52.202464 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:52.202245    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:58:56.202238933 +0000 UTC m=+97.457716137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:52.213364 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.213344    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:52.213451 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.213416    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:58:52.213735 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.213720    2560 scope.go:117] "RemoveContainer" containerID="400c4619a38e7a92e4dac6bbfb92ef43fdc47d9bca12ce5065a2ecd420e7b64b"
Jul 23 17:58:52.213865 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:52.213848    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hstvn_openshift-console-operator(fab3b010-3e1e-4332-a3bf-5c21a3c68a7c)\"" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" podUID="fab3b010-3e1e-4332-a3bf-5c21a3c68a7c"
Jul 23 17:58:52.247230 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.247209    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mz9qk_d2a5deb7-db60-4411-b869-163ef08ea9b0/serve-healthcheck-canary/0.log"
Jul 23 17:58:52.443661 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.443633    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fgvrh_02f3d940-5847-4bbe-88f6-1894e8d1b475/migrator/0.log"
Jul 23 17:58:52.560050 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.560027    2560 scope.go:117] "RemoveContainer" containerID="400c4619a38e7a92e4dac6bbfb92ef43fdc47d9bca12ce5065a2ecd420e7b64b"
Jul 23 17:58:52.560191 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:52.560172    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hstvn_openshift-console-operator(fab3b010-3e1e-4332-a3bf-5c21a3c68a7c)\"" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" podUID="fab3b010-3e1e-4332-a3bf-5c21a3c68a7c"
Jul 23 17:58:52.644984 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:52.644960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fgvrh_02f3d940-5847-4bbe-88f6-1894e8d1b475/graceful-termination/0.log"
Jul 23 17:58:53.491575 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:53.491542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:53.645045 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:53.645013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:53.757426 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:53.757357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:53.857358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:53.857327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:54.049650 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:54.049621    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:54.171361 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:54.171332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:54.375381 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:54.375312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:55.385849 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:55.385811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:55.588334 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:55.588259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:55.771284 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:55.771208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:55.969965 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:55.969935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:56.176900 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:56.176869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:56.234884 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:56.234854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:56.235027 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:56.234889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:58:56.235027 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:56.234996    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:56.235092 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:56.235036    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:56.235092 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:56.235070    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:59:04.235055948 +0000 UTC m=+105.490533152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:56.235092 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:58:56.235091    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm podName:846c558b-787c-491f-b363-7b006b0471ba nodeName:}" failed. No retries permitted until 2026-07-23 17:59:04.235078918 +0000 UTC m=+105.490556126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hswxc" (UID: "846c558b-787c-491f-b363-7b006b0471ba") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:57.185019 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.184980    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:57.308463 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.308427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:57.517916 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.517843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:57.616157 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.616124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:57.746977 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.746952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:57.749231 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.749206    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db2cd433-c8f7-4ead-a116-a43ff78f0b6d-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-s9k99\" (UID: \"db2cd433-c8f7-4ead-a116-a43ff78f0b6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:57.796875 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.796849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:57.806768 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.806746    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"
Jul 23 17:58:57.925558 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.925531    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99"]
Jul 23 17:58:57.970472 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:57.970445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:58.073702 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.073629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:58.365378 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.365316    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:58.553311 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.553282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:58:58.553447 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.553321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:58:58.555566 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.555535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9c472ce-649d-461f-a266-3d130826682f-metrics-tls\") pod \"dns-default-5tdrn\" (UID: \"b9c472ce-649d-461f-a266-3d130826682f\") " pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:58:58.555664 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.555597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"image-registry-85c848db4b-hcmjr\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") " pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:58:58.573655 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.573638    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djwnl\""
Jul 23 17:58:58.577581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.577553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99" event={"ID":"db2cd433-c8f7-4ead-a116-a43ff78f0b6d","Type":"ContainerStarted","Data":"e91acd743fa6e83078f2c4f759221e4cf74c0dba4003f2f9e18086c5cde48231"}
Jul 23 17:58:58.580735 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.580719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:58:58.733436 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.733413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tdrn"]
Jul 23 17:58:58.735824 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:58:58.735794    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c472ce_649d_461f_a266_3d130826682f.slice/crio-9929939fef03cf14670f3071c1a014da64f1e6a965e0fd34a0d11d952a0ab7b9 WatchSource:0}: Error finding container 9929939fef03cf14670f3071c1a014da64f1e6a965e0fd34a0d11d952a0ab7b9: Status 404 returned error can't find the container with id 9929939fef03cf14670f3071c1a014da64f1e6a965e0fd34a0d11d952a0ab7b9
Jul 23 17:58:58.852762 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.852737    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lk5rs\""
Jul 23 17:58:58.860078 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.860053    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:58:58.954047 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:58.954012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:59.013226 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.013199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c848db4b-hcmjr"]
Jul 23 17:58:59.017788 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:58:59.017759    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb90b05_f9b1_409f_890e_111bd50340a8.slice/crio-0c6008b3a21dc0aa44e3301d3b5d8f26a3693b38eafdbc44ee6df4aa25548140 WatchSource:0}: Error finding container 0c6008b3a21dc0aa44e3301d3b5d8f26a3693b38eafdbc44ee6df4aa25548140: Status 404 returned error can't find the container with id 0c6008b3a21dc0aa44e3301d3b5d8f26a3693b38eafdbc44ee6df4aa25548140
Jul 23 17:58:59.166101 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.166025    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:59.561317 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.561288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:59.582475 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.582438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tdrn" event={"ID":"b9c472ce-649d-461f-a266-3d130826682f","Type":"ContainerStarted","Data":"9929939fef03cf14670f3071c1a014da64f1e6a965e0fd34a0d11d952a0ab7b9"}
Jul 23 17:58:59.584478 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.584453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr" event={"ID":"7fb90b05-f9b1-409f-890e-111bd50340a8","Type":"ContainerStarted","Data":"659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb"}
Jul 23 17:58:59.584601 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.584491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr" event={"ID":"7fb90b05-f9b1-409f-890e-111bd50340a8","Type":"ContainerStarted","Data":"0c6008b3a21dc0aa44e3301d3b5d8f26a3693b38eafdbc44ee6df4aa25548140"}
Jul 23 17:58:59.584812 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.584737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:58:59.714418 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.714373    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:59.839856 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.839770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:58:59.962472 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:58:59.962437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:00.180340 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:00.180306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:00.590097 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:00.590054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99" event={"ID":"db2cd433-c8f7-4ead-a116-a43ff78f0b6d","Type":"ContainerStarted","Data":"3e47777cfdb3c7fe0596dc2d0953e4248c84b01167c6e67f29016cd3f4c3543d"}
Jul 23 17:59:00.590554 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:00.590120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99" event={"ID":"db2cd433-c8f7-4ead-a116-a43ff78f0b6d","Type":"ContainerStarted","Data":"ebeb8fce2538d42ce2bb7306a669cc52a618db27ba850e6cdf4513a457a23d97"}
Jul 23 17:59:00.609896 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:00.609831    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-s9k99" podStartSLOduration=17.4924112 podStartE2EDuration="19.609811377s" totalImagesPullingTime="2.117400177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:00.609502278 +0000 UTC m=+101.864979518" watchObservedRunningTime="2026-07-23 17:59:00.609811377 +0000 UTC m=+101.865288605"
Jul 23 17:59:00.610920 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:00.610876    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr" podStartSLOduration=101.610859424 podStartE2EDuration="1m41.610859424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:59.610199342 +0000 UTC m=+100.865676568" watchObservedRunningTime="2026-07-23 17:59:00.610859424 +0000 UTC m=+101.866336653"
Jul 23 17:59:01.375731 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.375697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:01.501390 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.501358    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mvlhs"
Jul 23 17:59:01.574882 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.574844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:01.595064 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.595025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tdrn" event={"ID":"b9c472ce-649d-461f-a266-3d130826682f","Type":"ContainerStarted","Data":"58d77eac5bf6f88cdf0546fdbf0cdb775cd29242ccfa7333bae21b889d3e0ee1"}
Jul 23 17:59:01.595482 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.595107    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:59:01.595482 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.595143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tdrn" event={"ID":"b9c472ce-649d-461f-a266-3d130826682f","Type":"ContainerStarted","Data":"c1be3160b8b2e806a36469fb36ecaab1ffe41a52efc2664cc6a63c2236e9a8bb"}
Jul 23 17:59:01.780569 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.780492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:01.981991 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:01.981962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:02.202034 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:02.202003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:03.129609 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:03.129572    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:03.229244 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:03.229215    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:03.593186 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:03.593157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:03.773825 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:03.773795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:03.963314 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:03.963247    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:04.189450 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.189416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:04.297173 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.297148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:59:04.297287 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.297180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:59:04.297695 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.297639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/846c558b-787c-491f-b363-7b006b0471ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:59:04.299470 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.299449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/846c558b-787c-491f-b363-7b006b0471ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hswxc\" (UID: \"846c558b-787c-491f-b363-7b006b0471ba\") " pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:59:04.565810 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.565749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hswxc"
Jul 23 17:59:04.694519 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.694467    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5tdrn" podStartSLOduration=68.730730488 podStartE2EDuration="1m10.694446276s" totalImagesPullingTime="1.963715788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:01.626400343 +0000 UTC m=+102.881877568" watchObservedRunningTime="2026-07-23 17:59:04.694446276 +0000 UTC m=+105.949923526"
Jul 23 17:59:04.695114 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:04.695094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hswxc"]
Jul 23 17:59:04.700062 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:04.700038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846c558b_787c_491f_b363_7b006b0471ba.slice/crio-2bbdb4e9930128930e0dc935ad195fbd627a4aaaf1c9d710d5dd2c4b90981eab WatchSource:0}: Error finding container 2bbdb4e9930128930e0dc935ad195fbd627a4aaaf1c9d710d5dd2c4b90981eab: Status 404 returned error can't find the container with id 2bbdb4e9930128930e0dc935ad195fbd627a4aaaf1c9d710d5dd2c4b90981eab
Jul 23 17:59:05.134813 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:05.134752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:05.213815 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:05.213745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:05.609061 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:05.609025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hswxc" event={"ID":"846c558b-787c-491f-b363-7b006b0471ba","Type":"ContainerStarted","Data":"2bbdb4e9930128930e0dc935ad195fbd627a4aaaf1c9d710d5dd2c4b90981eab"}
Jul 23 17:59:08.166876 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:08.166842    2560 scope.go:117] "RemoveContainer" containerID="400c4619a38e7a92e4dac6bbfb92ef43fdc47d9bca12ce5065a2ecd420e7b64b"
Jul 23 17:59:09.624645 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:09.624556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hswxc" event={"ID":"846c558b-787c-491f-b363-7b006b0471ba","Type":"ContainerStarted","Data":"03bd81c9e613d51530f066682a528d136b56f88132b211fb7b632db275c9ec5a"}
Jul 23 17:59:09.626328 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:09.626310    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 17:59:09.626434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:09.626361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" event={"ID":"fab3b010-3e1e-4332-a3bf-5c21a3c68a7c","Type":"ContainerStarted","Data":"dc28fc751f98fa32c68a81412ff296c561a4d7da98774e1119c5018720db40e0"}
Jul 23 17:59:09.626611 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:09.626586    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:59:09.652292 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:09.652255    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-hstvn" podStartSLOduration=26.093157181 podStartE2EDuration="28.652242506s" totalImagesPullingTime="2.559085325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:09.651853048 +0000 UTC m=+110.907330278" watchObservedRunningTime="2026-07-23 17:59:09.652242506 +0000 UTC m=+110.907719732"
Jul 23 17:59:10.047621 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:10.047586    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-hstvn"
Jul 23 17:59:10.364204 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:10.364115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:10.482315 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:10.482285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:10.582506 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:10.582471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:10.741104 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:10.741012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:10.829827 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:10.829797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:11.130881 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:11.130820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:11.219344 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:11.219306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:11.600421 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:11.600397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5tdrn"
Jul 23 17:59:12.008062 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.007990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:12.110520 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.110483    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"]
Jul 23 17:59:12.115318 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.115296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:12.125859 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:12.125827    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"managed-serviceaccount-dockercfg-czvw2\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-czvw2\"" type="*v1.Secret"
Jul 23 17:59:12.126073 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:12.126040    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" podUID="c7921992-4a2d-496d-adc1-9fa010099847" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:12.126527 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:12.126497    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"managed-serviceaccount-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" type="*v1.Secret"
Jul 23 17:59:12.126617 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:12.126545    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"open-cluster-management-image-pull-credentials\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret"
Jul 23 17:59:12.126875 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:12.126834    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 23 17:59:12.126971 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:12.126894    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-71.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-71.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 23 17:59:12.145898 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.145875    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-7fffl"]
Jul 23 17:59:12.151714 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.151698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7fffl"
Jul 23 17:59:12.155308 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.155281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lh5z9\""
Jul 23 17:59:12.155598 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.155583    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 17:59:12.155921 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.155904    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 17:59:12.173791 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.173763    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"]
Jul 23 17:59:12.177501 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.177472    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7fffl"]
Jul 23 17:59:12.279736 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.279062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7921992-4a2d-496d-adc1-9fa010099847-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl\" (UID: \"c7921992-4a2d-496d-adc1-9fa010099847\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:12.279736 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.279105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9trc\" (UniqueName: \"kubernetes.io/projected/67ab10ce-3a34-498c-aa88-5b6bc28a33ff-kube-api-access-h9trc\") pod \"downloads-5bc67dcd46-7fffl\" (UID: \"67ab10ce-3a34-498c-aa88-5b6bc28a33ff\") " pod="openshift-console/downloads-5bc67dcd46-7fffl"
Jul 23 17:59:12.279736 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.279199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zqqh\" (UniqueName: \"kubernetes.io/projected/c7921992-4a2d-496d-adc1-9fa010099847-kube-api-access-6zqqh\") pod \"managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl\" (UID: \"c7921992-4a2d-496d-adc1-9fa010099847\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:12.380211 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.380135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqqh\" (UniqueName: \"kubernetes.io/projected/c7921992-4a2d-496d-adc1-9fa010099847-kube-api-access-6zqqh\") pod \"managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl\" (UID: \"c7921992-4a2d-496d-adc1-9fa010099847\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:12.380211 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.380202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7921992-4a2d-496d-adc1-9fa010099847-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl\" (UID: \"c7921992-4a2d-496d-adc1-9fa010099847\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:12.380438 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.380286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9trc\" (UniqueName: \"kubernetes.io/projected/67ab10ce-3a34-498c-aa88-5b6bc28a33ff-kube-api-access-h9trc\") pod \"downloads-5bc67dcd46-7fffl\" (UID: \"67ab10ce-3a34-498c-aa88-5b6bc28a33ff\") " pod="openshift-console/downloads-5bc67dcd46-7fffl"
Jul 23 17:59:12.400642 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.400612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:12.428502 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.428480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9trc\" (UniqueName: \"kubernetes.io/projected/67ab10ce-3a34-498c-aa88-5b6bc28a33ff-kube-api-access-h9trc\") pod \"downloads-5bc67dcd46-7fffl\" (UID: \"67ab10ce-3a34-498c-aa88-5b6bc28a33ff\") " pod="openshift-console/downloads-5bc67dcd46-7fffl"
Jul 23 17:59:12.463284 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.463259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7fffl"
Jul 23 17:59:12.675721 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.675652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:12.812023 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.812002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:12.827358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:12.827336    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7fffl"]
Jul 23 17:59:12.830260 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:12.830238    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ab10ce_3a34_498c_aa88_5b6bc28a33ff.slice/crio-7f898188bf9c7ecfb89e4a084219f14de5cc2e366cb6ca7bb32efb0928c66382 WatchSource:0}: Error finding container 7f898188bf9c7ecfb89e4a084219f14de5cc2e366cb6ca7bb32efb0928c66382: Status 404 returned error can't find the container with id 7f898188bf9c7ecfb89e4a084219f14de5cc2e366cb6ca7bb32efb0928c66382
Jul 23 17:59:13.146212 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.146186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 17:59:13.246385 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.246362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 17:59:13.253220 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.253195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7921992-4a2d-496d-adc1-9fa010099847-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl\" (UID: \"c7921992-4a2d-496d-adc1-9fa010099847\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:13.323730 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.323709    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 17:59:13.379745 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.379725    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 17:59:13.389211 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.389189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zqqh\" (UniqueName: \"kubernetes.io/projected/c7921992-4a2d-496d-adc1-9fa010099847-kube-api-access-6zqqh\") pod \"managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl\" (UID: \"c7921992-4a2d-496d-adc1-9fa010099847\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:13.642749 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.642702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7fffl" event={"ID":"67ab10ce-3a34-498c-aa88-5b6bc28a33ff","Type":"ContainerStarted","Data":"7f898188bf9c7ecfb89e4a084219f14de5cc2e366cb6ca7bb32efb0928c66382"}
Jul 23 17:59:13.644761 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.644719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hswxc" event={"ID":"846c558b-787c-491f-b363-7b006b0471ba","Type":"ContainerStarted","Data":"24f0d02da516f7a72ba59213be839f6a3d199f3977fa8fe6208c19233a5a0d3c"}
Jul 23 17:59:13.667929 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.667908    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-czvw2\""
Jul 23 17:59:13.673267 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.673244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"
Jul 23 17:59:13.811063 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:13.811032    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl"]
Jul 23 17:59:13.815887 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:13.814821    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7921992_4a2d_496d_adc1_9fa010099847.slice/crio-4b8aaa5c2de5abbd9cabc9240138d2d38be304aff8bb018f28e4ff3e6b0e1ae2 WatchSource:0}: Error finding container 4b8aaa5c2de5abbd9cabc9240138d2d38be304aff8bb018f28e4ff3e6b0e1ae2: Status 404 returned error can't find the container with id 4b8aaa5c2de5abbd9cabc9240138d2d38be304aff8bb018f28e4ff3e6b0e1ae2
Jul 23 17:59:14.650516 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:14.650480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl" event={"ID":"c7921992-4a2d-496d-adc1-9fa010099847","Type":"ContainerStarted","Data":"4b8aaa5c2de5abbd9cabc9240138d2d38be304aff8bb018f28e4ff3e6b0e1ae2"}
Jul 23 17:59:14.740341 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:14.740206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:14.842240 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:14.842129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:18.665599 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:18.665490    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl" event={"ID":"c7921992-4a2d-496d-adc1-9fa010099847","Type":"ContainerStarted","Data":"0a5ede4daab099ab6d9285572c5280ccd16f5defca4142afddcc7bf0efb32871"}
Jul 23 17:59:18.667902 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:18.667862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hswxc" event={"ID":"846c558b-787c-491f-b363-7b006b0471ba","Type":"ContainerStarted","Data":"cf69921cf5faa9ddf8ba9a80adccdddcd16883eaa0af825e67ef0426ba601606"}
Jul 23 17:59:18.685101 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:18.685054    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9f4f5b58-pc9hl" podStartSLOduration=2.134764733 podStartE2EDuration="6.685039363s" totalImagesPullingTime="4.55027463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:18.684030456 +0000 UTC m=+119.939507686" watchObservedRunningTime="2026-07-23 17:59:18.685039363 +0000 UTC m=+119.940516626"
Jul 23 17:59:18.711144 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:18.711097    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hswxc" podStartSLOduration=18.220826493 podStartE2EDuration="31.71108365s" totalImagesPullingTime="13.490257157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:58:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:18.709825537 +0000 UTC m=+119.965302776" watchObservedRunningTime="2026-07-23 17:59:18.71108365 +0000 UTC m=+119.966560876"
Jul 23 17:59:18.865089 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:18.865052    2560 patch_prober.go:28] interesting pod/image-registry-85c848db4b-hcmjr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 17:59:18.865245 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:18.865109    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr" podUID="7fb90b05-f9b1-409f-890e-111bd50340a8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 17:59:19.173468 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:19.173434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:19.264556 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:19.264521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:20.229735 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.229706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:20.341612 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.341570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:20.509586 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.509509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:20.513396 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.513370    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"]
Jul 23 17:59:20.516726 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.516707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:20.526860 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.526839    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kf87t\""
Jul 23 17:59:20.527174 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.527156    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 17:59:20.538628 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.538607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"]
Jul 23 17:59:20.540199 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.540170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49e81992-3b42-403a-9534-0622738eba12-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-m7trk\" (UID: \"49e81992-3b42-403a-9534-0622738eba12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:20.594158 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.594130    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 17:59:20.641110 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.641077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49e81992-3b42-403a-9534-0622738eba12-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-m7trk\" (UID: \"49e81992-3b42-403a-9534-0622738eba12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:20.641252 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:20.641196    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 17:59:20.641375 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:20.641258    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49e81992-3b42-403a-9534-0622738eba12-tls-certificates podName:49e81992-3b42-403a-9534-0622738eba12 nodeName:}" failed. No retries permitted until 2026-07-23 17:59:21.141239394 +0000 UTC m=+122.396716598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/49e81992-3b42-403a-9534-0622738eba12-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-m7trk" (UID: "49e81992-3b42-403a-9534-0622738eba12") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 17:59:20.754130 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.754095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:20.900221 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.900187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:20.964087 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:20.964057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:21.145060 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:21.144986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49e81992-3b42-403a-9534-0622738eba12-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-m7trk\" (UID: \"49e81992-3b42-403a-9534-0622738eba12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:21.147661 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:21.147631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49e81992-3b42-403a-9534-0622738eba12-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-m7trk\" (UID: \"49e81992-3b42-403a-9534-0622738eba12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:21.426900 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:21.426855    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:21.577124 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:21.577092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"]
Jul 23 17:59:21.580938 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:21.580906    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e81992_3b42_403a_9534_0622738eba12.slice/crio-542243206de036680f392951aa205617f8793c0ee000cffeb5f01f2b72fee853 WatchSource:0}: Error finding container 542243206de036680f392951aa205617f8793c0ee000cffeb5f01f2b72fee853: Status 404 returned error can't find the container with id 542243206de036680f392951aa205617f8793c0ee000cffeb5f01f2b72fee853
Jul 23 17:59:21.605257 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:21.605230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:21.679543 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:21.679480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk" event={"ID":"49e81992-3b42-403a-9534-0622738eba12","Type":"ContainerStarted","Data":"542243206de036680f392951aa205617f8793c0ee000cffeb5f01f2b72fee853"}
Jul 23 17:59:21.703834 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:21.703802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:23.520703 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:23.520653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:23.612393 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:23.612353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:23.687770 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:23.687737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk" event={"ID":"49e81992-3b42-403a-9534-0622738eba12","Type":"ContainerStarted","Data":"5988b6401bc15c707232ddb9fbad3d81fbe357ede8c991f9491b4a9c76cef386"}
Jul 23 17:59:23.687987 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:23.687956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:23.692896 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:23.692873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk"
Jul 23 17:59:23.705584 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:23.705538    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-m7trk" podStartSLOduration=2.313647704 podStartE2EDuration="3.705518932s" totalImagesPullingTime="1.391871228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:23.70523283 +0000 UTC m=+124.960710058" watchObservedRunningTime="2026-07-23 17:59:23.705518932 +0000 UTC m=+124.960996158"
Jul 23 17:59:24.572735 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:24.572698    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:24.666554 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:24.666524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:24.726764 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:24.726735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:25.362028 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.361998    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76fbbbbfff-hl2xx"]
Jul 23 17:59:25.366279 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.366256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.369681 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.369650    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 17:59:25.372594 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.372572    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 17:59:25.374796 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.374775    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 17:59:25.375138 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.375048    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z474v\""
Jul 23 17:59:25.375138 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.375048    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 17:59:25.375280 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.375074    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 17:59:25.378477 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.378452    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 17:59:25.380581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.380557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76fbbbbfff-hl2xx"]
Jul 23 17:59:25.481638 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.481605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-oauth-serving-cert\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.481827 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.481655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nr55\" (UniqueName: \"kubernetes.io/projected/cc665070-5c0b-47f8-a149-0807c3327677-kube-api-access-8nr55\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.481827 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.481743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-serving-cert\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.481827 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.481790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-console-config\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.481999 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.481838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-service-ca\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.481999 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.481875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-oauth-config\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.481999 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.481901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-trusted-ca-bundle\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.582871 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.582835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-service-ca\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.583335 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.582901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-oauth-config\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.583335 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.582929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-trusted-ca-bundle\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.583335 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.582969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-oauth-serving-cert\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.583335 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.582997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nr55\" (UniqueName: \"kubernetes.io/projected/cc665070-5c0b-47f8-a149-0807c3327677-kube-api-access-8nr55\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.583335 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.583033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-serving-cert\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.583335 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.583058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-console-config\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.583773 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.583723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-service-ca\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.584241 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.584209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-console-config\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.584241 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.584222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-oauth-serving-cert\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.584389 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.584222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-trusted-ca-bundle\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.585952 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.585931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-oauth-config\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.586218 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.586197    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-serving-cert\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.596714 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.596693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nr55\" (UniqueName: \"kubernetes.io/projected/cc665070-5c0b-47f8-a149-0807c3327677-kube-api-access-8nr55\") pod \"console-76fbbbbfff-hl2xx\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") " pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.676358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.676302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:25.685797 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:25.685772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:26.575742 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:26.575702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:26.677722 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:26.677665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:26.810485 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:26.810444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:28.714443 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:28.714399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:29.081163 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.081108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:29.193049 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.192972    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m8876"]
Jul 23 17:59:29.196368 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.196345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.204883 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.204837    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 17:59:29.204883 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.204869    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 17:59:29.211041 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.211018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:59:29.211697 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.211663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 17:59:29.211697 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.211689    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 17:59:29.211878 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.211779    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 17:59:29.211968 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.211949    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 17:59:29.212025 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.211989    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c7sl6\""
Jul 23 17:59:29.213802 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.213782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679-metrics-certs\") pod \"network-metrics-daemon-7lxtj\" (UID: \"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679\") " pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:59:29.274197 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.274141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:29.312078 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-wtmp\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312255 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adccf88-550c-40f6-9d60-03fcd7c78f72-metrics-client-ca\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312255 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhvcd\" (UniqueName: \"kubernetes.io/projected/8adccf88-550c-40f6-9d60-03fcd7c78f72-kube-api-access-mhvcd\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312255 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-textfile\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-accelerators-collector-config\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-sys\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-root\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.312434 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.312407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.412850 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-wtmp\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.412850 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adccf88-550c-40f6-9d60-03fcd7c78f72-metrics-client-ca\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.412850 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhvcd\" (UniqueName: \"kubernetes.io/projected/8adccf88-550c-40f6-9d60-03fcd7c78f72-kube-api-access-mhvcd\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-wtmp\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-textfile\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-accelerators-collector-config\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-sys\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.412984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-root\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.413007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:29.413096    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 17:59:29.413185 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:29.413156    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls podName:8adccf88-550c-40f6-9d60-03fcd7c78f72 nodeName:}" failed. No retries permitted until 2026-07-23 17:59:29.913137647 +0000 UTC m=+131.168614851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls") pod "node-exporter-m8876" (UID: "8adccf88-550c-40f6-9d60-03fcd7c78f72") : secret "node-exporter-tls" not found
Jul 23 17:59:29.413648 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.413359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-sys\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413648 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.413406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8adccf88-550c-40f6-9d60-03fcd7c78f72-root\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413648 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.413480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8adccf88-550c-40f6-9d60-03fcd7c78f72-metrics-client-ca\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413838 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.413694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-accelerators-collector-config\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.413838 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.413771    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-textfile\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.416050 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.416025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.429724 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.429684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:29.431550 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.431528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhvcd\" (UniqueName: \"kubernetes.io/projected/8adccf88-550c-40f6-9d60-03fcd7c78f72-kube-api-access-mhvcd\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.485032 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.485001    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdhp\""
Jul 23 17:59:29.492431 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.492401    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lxtj"
Jul 23 17:59:29.603986 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.603925    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:29.748811 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.748664    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:29.874844 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.874808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:29.918412 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:29.918381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:29.918577 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:29.918501    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 17:59:29.918577 ip-10-0-129-71 kubenswrapper[2560]: E0723 17:59:29.918558    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls podName:8adccf88-550c-40f6-9d60-03fcd7c78f72 nodeName:}" failed. No retries permitted until 2026-07-23 17:59:30.91854079 +0000 UTC m=+132.174017995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls") pod "node-exporter-m8876" (UID: "8adccf88-550c-40f6-9d60-03fcd7c78f72") : secret "node-exporter-tls" not found
Jul 23 17:59:30.125970 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.125936    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:30.346448 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.346397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:30.462190 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.462110    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 17:59:30.467962 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.467932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:30.512297 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.512267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 17:59:30.512477 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.512452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.517696 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.517648    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 17:59:30.517696 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.517651    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 17:59:30.518322 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.518195    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 17:59:30.520619 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.520567    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-28k24\""
Jul 23 17:59:30.521040 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.520786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 17:59:30.521565 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.521389    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 17:59:30.521565 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.521457    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 17:59:30.523900 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.523881    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 17:59:30.525381 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.525363    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 17:59:30.527527 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.527506    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 17:59:30.625221 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625375 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625375 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b35c447-4c09-451e-89e0-1f167a3cfdb0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625502 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b35c447-4c09-451e-89e0-1f167a3cfdb0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625502 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625425    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b35c447-4c09-451e-89e0-1f167a3cfdb0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625502 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-web-config\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625502 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625661 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625661 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b35c447-4c09-451e-89e0-1f167a3cfdb0-config-out\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625661 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625626    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625661 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzfg4\" (UniqueName: \"kubernetes.io/projected/3b35c447-4c09-451e-89e0-1f167a3cfdb0-kube-api-access-zzfg4\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625855 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.625855 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.625707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b35c447-4c09-451e-89e0-1f167a3cfdb0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.726936 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.726858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.726936 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.726902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b35c447-4c09-451e-89e0-1f167a3cfdb0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727152 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.726942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b35c447-4c09-451e-89e0-1f167a3cfdb0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b35c447-4c09-451e-89e0-1f167a3cfdb0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-web-config\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727359 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727359 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b35c447-4c09-451e-89e0-1f167a3cfdb0-config-out\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727359 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727359 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzfg4\" (UniqueName: \"kubernetes.io/projected/3b35c447-4c09-451e-89e0-1f167a3cfdb0-kube-api-access-zzfg4\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727359 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727595 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b35c447-4c09-451e-89e0-1f167a3cfdb0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.727595 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.729132 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.727811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b35c447-4c09-451e-89e0-1f167a3cfdb0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.729132 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.728573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b35c447-4c09-451e-89e0-1f167a3cfdb0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.729132 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.729034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b35c447-4c09-451e-89e0-1f167a3cfdb0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.730289 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.730244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b35c447-4c09-451e-89e0-1f167a3cfdb0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.731074 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.731035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.731074 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.731055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.731799 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.731760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.731977 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.731958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-web-config\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.732622 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.732599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.732729 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.732653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.733158 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.733137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b35c447-4c09-451e-89e0-1f167a3cfdb0-config-out\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.734031 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.734012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b35c447-4c09-451e-89e0-1f167a3cfdb0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.740300 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.740279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzfg4\" (UniqueName: \"kubernetes.io/projected/3b35c447-4c09-451e-89e0-1f167a3cfdb0-kube-api-access-zzfg4\") pod \"alertmanager-main-0\" (UID: \"3b35c447-4c09-451e-89e0-1f167a3cfdb0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.824309 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.824282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 17:59:30.929344 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.929305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:30.932156 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:30.932133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8adccf88-550c-40f6-9d60-03fcd7c78f72-node-exporter-tls\") pod \"node-exporter-m8876\" (UID: \"8adccf88-550c-40f6-9d60-03fcd7c78f72\") " pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:31.008307 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:31.008228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m8876"
Jul 23 17:59:31.401321 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:31.401274    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adccf88_550c_40f6_9d60_03fcd7c78f72.slice/crio-8d5a25772e4c16bfd8cdfd4848bb46121744e6d86b479352bf01ea4325436d1b WatchSource:0}: Error finding container 8d5a25772e4c16bfd8cdfd4848bb46121744e6d86b479352bf01ea4325436d1b: Status 404 returned error can't find the container with id 8d5a25772e4c16bfd8cdfd4848bb46121744e6d86b479352bf01ea4325436d1b
Jul 23 17:59:31.563031 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:31.562997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76fbbbbfff-hl2xx"]
Jul 23 17:59:31.679261 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:31.679188    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc665070_5c0b_47f8_a149_0807c3327677.slice/crio-2b297b7b5467462d81f3e76bdb187dc8f7c74c4a3fee1ad512555ae0389d1156 WatchSource:0}: Error finding container 2b297b7b5467462d81f3e76bdb187dc8f7c74c4a3fee1ad512555ae0389d1156: Status 404 returned error can't find the container with id 2b297b7b5467462d81f3e76bdb187dc8f7c74c4a3fee1ad512555ae0389d1156
Jul 23 17:59:31.718401 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:31.718368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fbbbbfff-hl2xx" event={"ID":"cc665070-5c0b-47f8-a149-0807c3327677","Type":"ContainerStarted","Data":"2b297b7b5467462d81f3e76bdb187dc8f7c74c4a3fee1ad512555ae0389d1156"}
Jul 23 17:59:31.719517 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:31.719494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8876" event={"ID":"8adccf88-550c-40f6-9d60-03fcd7c78f72","Type":"ContainerStarted","Data":"8d5a25772e4c16bfd8cdfd4848bb46121744e6d86b479352bf01ea4325436d1b"}
Jul 23 17:59:31.782977 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:31.782951    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lxtj"]
Jul 23 17:59:31.787183 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:31.787156    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bbf3b6c_4d2d_4eff_bc7e_4ee34f7d9679.slice/crio-d69e599ef0e0633a8eb81ef41aee62974b010a275be45fa2f8d25fb90897a568 WatchSource:0}: Error finding container d69e599ef0e0633a8eb81ef41aee62974b010a275be45fa2f8d25fb90897a568: Status 404 returned error can't find the container with id d69e599ef0e0633a8eb81ef41aee62974b010a275be45fa2f8d25fb90897a568
Jul 23 17:59:31.791128 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:31.791103    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 17:59:31.794545 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:31.794498    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b35c447_4c09_451e_89e0_1f167a3cfdb0.slice/crio-b4f981a52db7832731468e6d5ccc747021017632363142e02092e8799319c0b8 WatchSource:0}: Error finding container b4f981a52db7832731468e6d5ccc747021017632363142e02092e8799319c0b8: Status 404 returned error can't find the container with id b4f981a52db7832731468e6d5ccc747021017632363142e02092e8799319c0b8
Jul 23 17:59:32.036196 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.036149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:32.135258 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.135171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:32.228913 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.228869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:32.730438 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.730349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7fffl" event={"ID":"67ab10ce-3a34-498c-aa88-5b6bc28a33ff","Type":"ContainerStarted","Data":"e4ae5f34f320a0e50f22cf08aefaf63a16d063200691fb99604ab9a6d535b365"}
Jul 23 17:59:32.733001 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.730961    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-7fffl"
Jul 23 17:59:32.734875 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.734848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"b4f981a52db7832731468e6d5ccc747021017632363142e02092e8799319c0b8"}
Jul 23 17:59:32.736544 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.736374    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:32.737446 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.737420    2560 generic.go:356] "Generic (PLEG): container finished" podID="8adccf88-550c-40f6-9d60-03fcd7c78f72" containerID="17610d1ff78cdb284ae250afe0c0b5320d47c57e7b1da3a55b3536b61545e79a" exitCode=0
Jul 23 17:59:32.737529 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.737497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8876" event={"ID":"8adccf88-550c-40f6-9d60-03fcd7c78f72","Type":"ContainerDied","Data":"17610d1ff78cdb284ae250afe0c0b5320d47c57e7b1da3a55b3536b61545e79a"}
Jul 23 17:59:32.741656 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.741637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-7fffl"
Jul 23 17:59:32.741958 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.741934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lxtj" event={"ID":"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679","Type":"ContainerStarted","Data":"d69e599ef0e0633a8eb81ef41aee62974b010a275be45fa2f8d25fb90897a568"}
Jul 23 17:59:32.786613 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.786353    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-7fffl" podStartSLOduration=1.87137314 podStartE2EDuration="20.78633157s" totalImagesPullingTime="18.91495843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:32.784079633 +0000 UTC m=+134.039556860" watchObservedRunningTime="2026-07-23 17:59:32.78633157 +0000 UTC m=+134.041808797"
Jul 23 17:59:32.859037 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:32.858973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:33.024210 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.024109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:33.132048 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.131999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:33.284207 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.284084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:33.702243 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.700875    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"]
Jul 23 17:59:33.728227 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.728189    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.736987 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.736791    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 17:59:33.742334 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.738408    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 17:59:33.742334 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.738877    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-srdsv\""
Jul 23 17:59:33.742334 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.740918    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 17:59:33.743796 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.742944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"]
Jul 23 17:59:33.745352 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.744575    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a9inkp1gstbfu\""
Jul 23 17:59:33.747694 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.747659    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 17:59:33.760263 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.760237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8876" event={"ID":"8adccf88-550c-40f6-9d60-03fcd7c78f72","Type":"ContainerStarted","Data":"62f0a886d650b228208320ab6d00e481e9921c7e34285ec5b13053f8938e2a70"}
Jul 23 17:59:33.760443 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.760423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m8876" event={"ID":"8adccf88-550c-40f6-9d60-03fcd7c78f72","Type":"ContainerStarted","Data":"acb1c6445d75f326025ffd714aba3a08c24e0a286dfed65a9b9702da6d65c7f3"}
Jul 23 17:59:33.840269 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.840201    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m8876" podStartSLOduration=3.810856504 podStartE2EDuration="4.840176666s" totalImagesPullingTime="936.680605ms" totalInitContainerRuntime="92.639557ms" isStatefulPod=true podCreationTimestamp="2026-07-23 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:33.838888081 +0000 UTC m=+135.094365308" watchObservedRunningTime="2026-07-23 17:59:33.840176666 +0000 UTC m=+135.095653893"
Jul 23 17:59:33.862560 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.862443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f1c5147-f49e-4cc3-a46e-03ab065e1613-metrics-server-audit-profiles\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.862769 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.862588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f1c5147-f49e-4cc3-a46e-03ab065e1613-audit-log\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.862769 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.862638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-secret-metrics-server-tls\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.862769 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.862707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9bf\" (UniqueName: \"kubernetes.io/projected/5f1c5147-f49e-4cc3-a46e-03ab065e1613-kube-api-access-2v9bf\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.862979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.862826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1c5147-f49e-4cc3-a46e-03ab065e1613-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.862979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.862862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-secret-metrics-server-client-certs\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.862979 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.862892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-client-ca-bundle\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.909216 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.909173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:33.964437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.963900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f1c5147-f49e-4cc3-a46e-03ab065e1613-metrics-server-audit-profiles\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.964437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.963973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f1c5147-f49e-4cc3-a46e-03ab065e1613-audit-log\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.964437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.964003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-secret-metrics-server-tls\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.964437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.964043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9bf\" (UniqueName: \"kubernetes.io/projected/5f1c5147-f49e-4cc3-a46e-03ab065e1613-kube-api-access-2v9bf\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.964437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.964108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1c5147-f49e-4cc3-a46e-03ab065e1613-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.964437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.964137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-secret-metrics-server-client-certs\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.964437 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.964167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-client-ca-bundle\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.965167 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.965133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f1c5147-f49e-4cc3-a46e-03ab065e1613-metrics-server-audit-profiles\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.966004 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.965515    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f1c5147-f49e-4cc3-a46e-03ab065e1613-audit-log\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.966835 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.966799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1c5147-f49e-4cc3-a46e-03ab065e1613-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.968664 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.968638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-secret-metrics-server-client-certs\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.969084 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.969062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-secret-metrics-server-tls\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:33.970011 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:33.969986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1c5147-f49e-4cc3-a46e-03ab065e1613-client-ca-bundle\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:34.008212 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.008134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9bf\" (UniqueName: \"kubernetes.io/projected/5f1c5147-f49e-4cc3-a46e-03ab065e1613-kube-api-access-2v9bf\") pod \"metrics-server-6c4b4b96d-qwjzv\" (UID: \"5f1c5147-f49e-4cc3-a46e-03ab065e1613\") " pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:34.048172 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.048042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:34.061070 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.060983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:34.210463 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.210421    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:34.594205 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.593934    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"]
Jul 23 17:59:34.618892 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.617441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.627900 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.627766    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 17:59:34.629466 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.628015    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 17:59:34.629466 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.628429    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rkp4l\""
Jul 23 17:59:34.629466 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.628799    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 17:59:34.629466 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.629223    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 17:59:34.633330 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.633295    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 17:59:34.635947 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.635919    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 17:59:34.646522 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.646462    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"]
Jul 23 17:59:34.672358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-telemeter-client-tls\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.672358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwchj\" (UniqueName: \"kubernetes.io/projected/8d515dea-d929-4191-9b11-edd30656c496-kube-api-access-lwchj\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.672358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-metrics-client-ca\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.672358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-secret-telemeter-client\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.672358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-serving-certs-ca-bundle\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.672358 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.672917 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-federate-client-tls\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.673102 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.672935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.676047 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.675975    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"]
Jul 23 17:59:34.766020 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.765913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"bf2e4862453d3e161ec5d7a382d0da0547e5c7f7569d550b9f01dc25cb3c4763"}
Jul 23 17:59:34.767995 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.767963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lxtj" event={"ID":"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679","Type":"ContainerStarted","Data":"d546ccc513cc6b654d61688137531ee9dc12788ab9223e30d432ea21b91564e1"}
Jul 23 17:59:34.773922 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.773894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-telemeter-client-tls\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.774040 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.773943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwchj\" (UniqueName: \"kubernetes.io/projected/8d515dea-d929-4191-9b11-edd30656c496-kube-api-access-lwchj\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.774040 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.773975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-metrics-client-ca\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.774189 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.774047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-secret-telemeter-client\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.774189 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.774090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-serving-certs-ca-bundle\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.774189 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.774118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.774189 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.774157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-federate-client-tls\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.774189 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.774188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.775718 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.775144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.775718 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.775529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-serving-certs-ca-bundle\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.776043 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.776019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d515dea-d929-4191-9b11-edd30656c496-metrics-client-ca\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.777431 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.777405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.777525 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.777412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-telemeter-client-tls\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.778629 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.778605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-secret-telemeter-client\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.779883 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.779862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8d515dea-d929-4191-9b11-edd30656c496-federate-client-tls\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.790072 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.790027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwchj\" (UniqueName: \"kubernetes.io/projected/8d515dea-d929-4191-9b11-edd30656c496-kube-api-access-lwchj\") pod \"telemeter-client-78ffb8fddf-drdl7\" (UID: \"8d515dea-d929-4191-9b11-edd30656c496\") " pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:34.930304 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:34.930218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"
Jul 23 17:59:35.257930 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.257807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:35.379879 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.379843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:35.631921 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.631882    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:35.666911 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.666877    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 17:59:35.726255 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.726220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783095 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783293 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783293 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783293 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783293 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783197    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783293 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0ca259b-127b-43de-b1ba-16bbe33d77e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783425    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjlf\" (UniqueName: \"kubernetes.io/projected/a0ca259b-127b-43de-b1ba-16bbe33d77e3-kube-api-access-vhjlf\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.783581 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.784029 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.784029 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0ca259b-127b-43de-b1ba-16bbe33d77e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.784029 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.784029 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-config\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.784029 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.783767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.845772 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.845740    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 17:59:35.845922 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.845755    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 17:59:35.846153 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.846129    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 17:59:35.846264 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.846136    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7fd7l\""
Jul 23 17:59:35.863712 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.863687    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a4tqq0u1cop6d\""
Jul 23 17:59:35.870202 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870146    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870735    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870791    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870739    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870855    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870950    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870796    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.870746    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 17:59:35.871261 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.871072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 17:59:35.884612 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.884612 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.884612 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0ca259b-127b-43de-b1ba-16bbe33d77e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjlf\" (UniqueName: \"kubernetes.io/projected/a0ca259b-127b-43de-b1ba-16bbe33d77e3-kube-api-access-vhjlf\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.884992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0ca259b-127b-43de-b1ba-16bbe33d77e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-config\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.885242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.886103 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.886103 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.886103 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.886103 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.886103 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.886103 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.885569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.887851 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.886923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.887851 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.887109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.887851 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.887593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.887851 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.887631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.890905 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.890881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.895789 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.893141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.895789 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.894497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.895789 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.894906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0ca259b-127b-43de-b1ba-16bbe33d77e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.895789 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.895108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.895789 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.895280    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 17:59:35.895789 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.895284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.896698 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.896320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.896698 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.896564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-config\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.899084 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.898888    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 17:59:35.899084 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.898915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0ca259b-127b-43de-b1ba-16bbe33d77e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.901223 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.899410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.902650 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.902227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.902650 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.902608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.902830 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.902799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0ca259b-127b-43de-b1ba-16bbe33d77e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.908661 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.908615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ca259b-127b-43de-b1ba-16bbe33d77e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:35.989385 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:35.989358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjlf\" (UniqueName: \"kubernetes.io/projected/a0ca259b-127b-43de-b1ba-16bbe33d77e3-kube-api-access-vhjlf\") pod \"prometheus-k8s-0\" (UID: \"a0ca259b-127b-43de-b1ba-16bbe33d77e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:36.007629 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.007583    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 17:59:36.031166 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.031138    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c848db4b-hcmjr"]
Jul 23 17:59:36.040406 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.040180    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:36.177239 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.177205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78ffb8fddf-drdl7"]
Jul 23 17:59:36.396351 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.396319    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 17:59:36.400241 ip-10-0-129-71 kubenswrapper[2560]: W0723 17:59:36.400212    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ca259b_127b_43de_b1ba_16bbe33d77e3.slice/crio-89b0e950c5877c9a1f2788240093df50ce4cf5b7cd0ddfa729e2da2dbba35bbd WatchSource:0}: Error finding container 89b0e950c5877c9a1f2788240093df50ce4cf5b7cd0ddfa729e2da2dbba35bbd: Status 404 returned error can't find the container with id 89b0e950c5877c9a1f2788240093df50ce4cf5b7cd0ddfa729e2da2dbba35bbd
Jul 23 17:59:36.404353 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.404294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:36.618405 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.618368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:36.781555 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.781452    2560 generic.go:356] "Generic (PLEG): container finished" podID="a0ca259b-127b-43de-b1ba-16bbe33d77e3" containerID="61535c2783085ed35ad8613d23fd9fd6bb9d12c3d72efb0c3589617237cde43b" exitCode=0
Jul 23 17:59:36.781866 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.781563    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerDied","Data":"61535c2783085ed35ad8613d23fd9fd6bb9d12c3d72efb0c3589617237cde43b"}
Jul 23 17:59:36.781866 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.781644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerStarted","Data":"89b0e950c5877c9a1f2788240093df50ce4cf5b7cd0ddfa729e2da2dbba35bbd"}
Jul 23 17:59:36.784665 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.784639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fbbbbfff-hl2xx" event={"ID":"cc665070-5c0b-47f8-a149-0807c3327677","Type":"ContainerStarted","Data":"1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0"}
Jul 23 17:59:36.787186 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.787117    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv" event={"ID":"5f1c5147-f49e-4cc3-a46e-03ab065e1613","Type":"ContainerStarted","Data":"41f4350c3148c634439f730937ef6abfe6f264cb6e5f3a5ec0d494d2dc8e942d"}
Jul 23 17:59:36.789322 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.789240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7" event={"ID":"8d515dea-d929-4191-9b11-edd30656c496","Type":"ContainerStarted","Data":"d7801bd00374e5d462e54ef3eab8a4a61462a049dab6c1a32a4446e2f020db91"}
Jul 23 17:59:36.792591 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.791795    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b35c447-4c09-451e-89e0-1f167a3cfdb0" containerID="bf2e4862453d3e161ec5d7a382d0da0547e5c7f7569d550b9f01dc25cb3c4763" exitCode=0
Jul 23 17:59:36.792591 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.791895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerDied","Data":"bf2e4862453d3e161ec5d7a382d0da0547e5c7f7569d550b9f01dc25cb3c4763"}
Jul 23 17:59:36.796303 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.795932    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lxtj" event={"ID":"0bbf3b6c-4d2d-4eff-bc7e-4ee34f7d9679","Type":"ContainerStarted","Data":"822717ac781802c0b52bff7bddff622e7b4e351135566ff93af458dbb2a12bf0"}
Jul 23 17:59:36.903866 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.903833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:36.940028 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.939936    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76fbbbbfff-hl2xx"]
Jul 23 17:59:36.967082 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:36.967009    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76fbbbbfff-hl2xx" podStartSLOduration=7.470394236 podStartE2EDuration="11.966993767s" totalImagesPullingTime="4.496599531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:36.964379537 +0000 UTC m=+138.219856767" watchObservedRunningTime="2026-07-23 17:59:36.966993767 +0000 UTC m=+138.222470994"
Jul 23 17:59:37.148370 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:37.148335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:37.285218 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:37.285130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:37.418417 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:37.418333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:38.812341 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:38.812302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv" event={"ID":"5f1c5147-f49e-4cc3-a46e-03ab065e1613","Type":"ContainerStarted","Data":"2572a4a831061abb02d69b393cc1380d5af9cc1a2897a531908298ee53920092"}
Jul 23 17:59:38.840769 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:38.840609    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv" podStartSLOduration=3.708811592 podStartE2EDuration="5.840591419s" totalImagesPullingTime="2.131779827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:38.840529936 +0000 UTC m=+140.096007163" watchObservedRunningTime="2026-07-23 17:59:38.840591419 +0000 UTC m=+140.096068646"
Jul 23 17:59:38.841288 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:38.841237    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7lxtj" podStartSLOduration=137.217386807 podStartE2EDuration="2m19.841222274s" totalImagesPullingTime="2.623835467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:37.006440701 +0000 UTC m=+138.261917927" watchObservedRunningTime="2026-07-23 17:59:38.841222274 +0000 UTC m=+140.096699502"
Jul 23 17:59:41.831181 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:41.831149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7" event={"ID":"8d515dea-d929-4191-9b11-edd30656c496","Type":"ContainerStarted","Data":"6bd8a2092abcd721c04270325abd3650077b7a0616fe7b27d1878e5dce0f301a"}
Jul 23 17:59:41.831541 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:41.831221    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7" event={"ID":"8d515dea-d929-4191-9b11-edd30656c496","Type":"ContainerStarted","Data":"700e293772c6dd568a190db50f72ce6667ed16049c33b10a4d6ab08fd163e376"}
Jul 23 17:59:41.834667 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:41.834641    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"5939f0285aa45258b22ac9370d0432398474c1b05f7dad74ee1a6f03ecbb4f7b"}
Jul 23 17:59:41.834787 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:41.834730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"5006f4c21dcda706dc42f7385d8aca3b9159a7d2c42449dcc8acf53d1b382517"}
Jul 23 17:59:42.292264 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.292235    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:42.435242 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.435206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:42.842022 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.841985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7" event={"ID":"8d515dea-d929-4191-9b11-edd30656c496","Type":"ContainerStarted","Data":"7e0c2512f011ca06bfcfe7849e8e79952cd667c5047a5d53213127b70da49442"}
Jul 23 17:59:42.845402 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.845375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"20235f9f2d67fc78319e07b52641e43c7d914bdb3c01e8f46b38a8c6daecd2ea"}
Jul 23 17:59:42.845554 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.845438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"bf12b9adeea9f8bf92fdca43da4f3ca4610a540f46f51a5a40454b452aa4b16c"}
Jul 23 17:59:42.845554 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.845466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"97ecd50d5c17885ad59e4de5bafa10a54736fb5cd0bc75c790756ec24b34b375"}
Jul 23 17:59:42.847498 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.847474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerStarted","Data":"411fbfac72082a33730462f82c4c57d7fb006e2b865cf4a9e484fc6c00a7398b"}
Jul 23 17:59:42.847617 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.847534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerStarted","Data":"c135abd62c8bc671a2dd8ab8ab8c938964c9e0794f5b777832fd5405db900ce5"}
Jul 23 17:59:42.909908 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.909836    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78ffb8fddf-drdl7" podStartSLOduration=3.619090128 podStartE2EDuration="8.909814799s" totalImagesPullingTime="5.290724671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:42.907317151 +0000 UTC m=+144.162794372" watchObservedRunningTime="2026-07-23 17:59:42.909814799 +0000 UTC m=+144.165292025"
Jul 23 17:59:42.985811 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:42.985775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:43.138744 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:43.138626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:44.218761 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.218726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:44.406856 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.406834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:44.858763 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.858729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b35c447-4c09-451e-89e0-1f167a3cfdb0","Type":"ContainerStarted","Data":"6f6f99c6b81de070ad3e9b1b7a02d1d4dfb088326a0e75cc43e3936fd4cb43cc"}
Jul 23 17:59:44.861981 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.861952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerStarted","Data":"da970e4cd104e0042f1e10246cd4755ba28db1f96a2d53513596b8435cab7741"}
Jul 23 17:59:44.862101 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.862006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerStarted","Data":"13e9428581705fb804a7ab85e77214c8e2dc6b5e786303096dacb836a4b3ed89"}
Jul 23 17:59:44.862101 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.862032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerStarted","Data":"8e8120499791b2b9dc7e86ced6a7134c37a9338215ee45341335fc569e92f1c8"}
Jul 23 17:59:44.862101 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.862055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ca259b-127b-43de-b1ba-16bbe33d77e3","Type":"ContainerStarted","Data":"2abe1c709eed6f722274ce315da57365e7a9f2dee1dc5ac914ac3761fcab9c0c"}
Jul 23 17:59:44.928597 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.928545    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.52746537 podStartE2EDuration="14.928525124s" totalImagesPullingTime="9.383677877s" totalInitContainerRuntime="17.381877ms" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:44.925947345 +0000 UTC m=+146.181424572" watchObservedRunningTime="2026-07-23 17:59:44.928525124 +0000 UTC m=+146.184002350"
Jul 23 17:59:44.996728 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:44.996650    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.763528084 podStartE2EDuration="9.99663373s" totalImagesPullingTime="7.195819488s" totalInitContainerRuntime="37.286158ms" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:44.994795004 +0000 UTC m=+146.250272230" watchObservedRunningTime="2026-07-23 17:59:44.99663373 +0000 UTC m=+146.252110959"
Jul 23 17:59:45.128474 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:45.128390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:45.362231 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:45.362197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:45.631458 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:45.631431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:45.677445 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:45.677416    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 17:59:46.040686 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:46.040653    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 17:59:47.112263 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:47.112230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:47.450240 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:47.450166    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:47.619099 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:47.619065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:49.639355 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:49.639321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:49.750147 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:49.750118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:49.838527 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:49.838497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:50.130837 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:50.130803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:50.258992 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:50.258966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:54.048575 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:54.048544    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:54.049043 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:54.048617    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 17:59:55.067800 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:55.067769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 17:59:55.175394 ip-10-0-129-71 kubenswrapper[2560]: I0723 17:59:55.175362    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:00:01.056471 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.056405    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr" podUID="7fb90b05-f9b1-409f-890e-111bd50340a8" containerName="registry" containerID="cri-o://659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb" gracePeriod=30
Jul 23 18:00:01.332361 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.332334    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 18:00:01.412135 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-certificates\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412300 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412147    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc2qv\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-kube-api-access-rc2qv\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412300 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-installation-pull-secrets\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412300 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412217    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-bound-sa-token\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412300 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-image-registry-private-configuration\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412300 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412282    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fb90b05-f9b1-409f-890e-111bd50340a8-ca-trust-extracted\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412552 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412307    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412552 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412347    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-trusted-ca\") pod \"7fb90b05-f9b1-409f-890e-111bd50340a8\" (UID: \"7fb90b05-f9b1-409f-890e-111bd50340a8\") "
Jul 23 18:00:01.412662 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412632    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:00:01.412971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.412934    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:00:01.414877 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.414842    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:00:01.415077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.415023    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-kube-api-access-rc2qv" (OuterVolumeSpecName: "kube-api-access-rc2qv") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "kube-api-access-rc2qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:00:01.415077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.415059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:00:01.415077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.415065    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:00:01.415274 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.415087    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:00:01.420832 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.420807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fb90b05-f9b1-409f-890e-111bd50340a8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7fb90b05-f9b1-409f-890e-111bd50340a8" (UID: "7fb90b05-f9b1-409f-890e-111bd50340a8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:00:01.513698 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513646    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-certificates\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.513698 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513694    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc2qv\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-kube-api-access-rc2qv\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.513698 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513703    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-installation-pull-secrets\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.513938 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513712    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-bound-sa-token\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.513938 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513723    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fb90b05-f9b1-409f-890e-111bd50340a8-image-registry-private-configuration\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.513938 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513732    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fb90b05-f9b1-409f-890e-111bd50340a8-ca-trust-extracted\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.513938 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513742    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fb90b05-f9b1-409f-890e-111bd50340a8-registry-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.513938 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.513750    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fb90b05-f9b1-409f-890e-111bd50340a8-trusted-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:01.930176 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.930142    2560 generic.go:356] "Generic (PLEG): container finished" podID="7fb90b05-f9b1-409f-890e-111bd50340a8" containerID="659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb" exitCode=0
Jul 23 18:00:01.930400 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.930189    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr"
Jul 23 18:00:01.930400 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.930204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr" event={"ID":"7fb90b05-f9b1-409f-890e-111bd50340a8","Type":"ContainerDied","Data":"659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb"}
Jul 23 18:00:01.930400 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.930243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c848db4b-hcmjr" event={"ID":"7fb90b05-f9b1-409f-890e-111bd50340a8","Type":"ContainerDied","Data":"0c6008b3a21dc0aa44e3301d3b5d8f26a3693b38eafdbc44ee6df4aa25548140"}
Jul 23 18:00:01.930400 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.930263    2560 scope.go:117] "RemoveContainer" containerID="659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb"
Jul 23 18:00:01.939000 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.938983    2560 scope.go:117] "RemoveContainer" containerID="659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb"
Jul 23 18:00:01.939260 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:00:01.939239    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb\": container with ID starting with 659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb not found: ID does not exist" containerID="659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb"
Jul 23 18:00:01.939300 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.939269    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb"} err="failed to get container status \"659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb\": rpc error: code = NotFound desc = could not find container \"659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb\": container with ID starting with 659fcac0c85585c020e372589c0041e0146ef65cd7f247fb5d8ea88de90b01cb not found: ID does not exist"
Jul 23 18:00:01.956838 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.956811    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85c848db4b-hcmjr"]
Jul 23 18:00:01.960204 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:01.960184    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85c848db4b-hcmjr"]
Jul 23 18:00:03.171262 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:03.171228    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fb90b05-f9b1-409f-890e-111bd50340a8" path="/var/lib/kubelet/pods/7fb90b05-f9b1-409f-890e-111bd50340a8/volumes"
Jul 23 18:00:03.843545 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:03.843499    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76fbbbbfff-hl2xx" podUID="cc665070-5c0b-47f8-a149-0807c3327677" containerName="console" containerID="cri-o://1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0" gracePeriod=15
Jul 23 18:00:04.119079 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.119023    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 18:00:04.135660 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135636    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-service-ca\") pod \"cc665070-5c0b-47f8-a149-0807c3327677\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") "
Jul 23 18:00:04.135779 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135711    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nr55\" (UniqueName: \"kubernetes.io/projected/cc665070-5c0b-47f8-a149-0807c3327677-kube-api-access-8nr55\") pod \"cc665070-5c0b-47f8-a149-0807c3327677\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") "
Jul 23 18:00:04.135779 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-trusted-ca-bundle\") pod \"cc665070-5c0b-47f8-a149-0807c3327677\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") "
Jul 23 18:00:04.135779 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135764    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-console-config\") pod \"cc665070-5c0b-47f8-a149-0807c3327677\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") "
Jul 23 18:00:04.135939 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135804    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-oauth-serving-cert\") pod \"cc665070-5c0b-47f8-a149-0807c3327677\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") "
Jul 23 18:00:04.135939 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135844    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-serving-cert\") pod \"cc665070-5c0b-47f8-a149-0807c3327677\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") "
Jul 23 18:00:04.135939 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135917    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-oauth-config\") pod \"cc665070-5c0b-47f8-a149-0807c3327677\" (UID: \"cc665070-5c0b-47f8-a149-0807c3327677\") "
Jul 23 18:00:04.136103 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.135989    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc665070-5c0b-47f8-a149-0807c3327677" (UID: "cc665070-5c0b-47f8-a149-0807c3327677"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:00:04.136160 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.136142    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:04.136211 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.136158    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-console-config" (OuterVolumeSpecName: "console-config") pod "cc665070-5c0b-47f8-a149-0807c3327677" (UID: "cc665070-5c0b-47f8-a149-0807c3327677"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:00:04.136211 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.136194    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc665070-5c0b-47f8-a149-0807c3327677" (UID: "cc665070-5c0b-47f8-a149-0807c3327677"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:00:04.136324 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.136204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc665070-5c0b-47f8-a149-0807c3327677" (UID: "cc665070-5c0b-47f8-a149-0807c3327677"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:00:04.138038 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.138014    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc665070-5c0b-47f8-a149-0807c3327677" (UID: "cc665070-5c0b-47f8-a149-0807c3327677"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:00:04.138123 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.138057    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc665070-5c0b-47f8-a149-0807c3327677" (UID: "cc665070-5c0b-47f8-a149-0807c3327677"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:00:04.138170 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.138125    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc665070-5c0b-47f8-a149-0807c3327677-kube-api-access-8nr55" (OuterVolumeSpecName: "kube-api-access-8nr55") pod "cc665070-5c0b-47f8-a149-0807c3327677" (UID: "cc665070-5c0b-47f8-a149-0807c3327677"). InnerVolumeSpecName "kube-api-access-8nr55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:00:04.236934 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.236908    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-oauth-serving-cert\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:04.236934 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.236931    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-serving-cert\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:04.236934 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.236941    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc665070-5c0b-47f8-a149-0807c3327677-console-oauth-config\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:04.237330 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.236950    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nr55\" (UniqueName: \"kubernetes.io/projected/cc665070-5c0b-47f8-a149-0807c3327677-kube-api-access-8nr55\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:04.237330 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.236959    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-trusted-ca-bundle\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:04.237330 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.236966    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc665070-5c0b-47f8-a149-0807c3327677-console-config\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:00:04.944271 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.944234    2560 generic.go:356] "Generic (PLEG): container finished" podID="cc665070-5c0b-47f8-a149-0807c3327677" containerID="1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0" exitCode=0
Jul 23 18:00:04.944432 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.944302    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fbbbbfff-hl2xx"
Jul 23 18:00:04.944432 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.944313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fbbbbfff-hl2xx" event={"ID":"cc665070-5c0b-47f8-a149-0807c3327677","Type":"ContainerDied","Data":"1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0"}
Jul 23 18:00:04.944432 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.944364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fbbbbfff-hl2xx" event={"ID":"cc665070-5c0b-47f8-a149-0807c3327677","Type":"ContainerDied","Data":"2b297b7b5467462d81f3e76bdb187dc8f7c74c4a3fee1ad512555ae0389d1156"}
Jul 23 18:00:04.944432 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.944386    2560 scope.go:117] "RemoveContainer" containerID="1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0"
Jul 23 18:00:04.952855 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.952839    2560 scope.go:117] "RemoveContainer" containerID="1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0"
Jul 23 18:00:04.953108 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:00:04.953089    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0\": container with ID starting with 1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0 not found: ID does not exist" containerID="1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0"
Jul 23 18:00:04.953161 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.953115    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0"} err="failed to get container status \"1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0\": rpc error: code = NotFound desc = could not find container \"1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0\": container with ID starting with 1ca7dbbf9bad71f60c651bb7113863351069f846aca17c767bd1aeaac9410ea0 not found: ID does not exist"
Jul 23 18:00:04.966158 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.966136    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76fbbbbfff-hl2xx"]
Jul 23 18:00:04.973092 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:04.973073    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76fbbbbfff-hl2xx"]
Jul 23 18:00:05.097111 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:05.097069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:00:05.171597 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:05.171571    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc665070-5c0b-47f8-a149-0807c3327677" path="/var/lib/kubelet/pods/cc665070-5c0b-47f8-a149-0807c3327677/volumes"
Jul 23 18:00:05.363752 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:05.363718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:00:14.054109 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:14.054037    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 18:00:14.058045 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:14.058020    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c4b4b96d-qwjzv"
Jul 23 18:00:36.040863 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:36.040824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:00:36.060629 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:36.060607    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:00:36.082668 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:36.082647    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:00:45.537263 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:45.537218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:00:45.683450 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:45.683419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:00:57.486912 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:57.486879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:00:57.586222 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:00:57.586183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:05.159799 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:05.159761    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:05.258292 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:05.258264    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:10.361299 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:10.361267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:10.424893 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:10.424858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:10.527983 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:10.527948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:11.309237 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:11.309205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:11.387872 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:11.387844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:21.346799 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:21.346759    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:21.449381 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:21.449353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:21.550626 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:21.550583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:28.561628 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:28.561587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:28.738666 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:28.738631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:29.359751 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:29.359720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:31.505564 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:31.505531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:31.616151 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:31.616099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:01:59.584491 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:01:59.584458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:00.176786 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:00.176735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:03.763210 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:03.763174    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:03.861692 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:03.861641    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:06.132247 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:06.132197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:06.223213 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:06.223177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:06.859166 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:06.859134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:07.177069 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:07.176988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:08.305534 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:08.305499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:08.760793 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:08.760719    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:09.822443 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:09.822411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:09.926062 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:09.926029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:12.755813 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.755778    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"]
Jul 23 18:02:12.756233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.756094    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fb90b05-f9b1-409f-890e-111bd50340a8" containerName="registry"
Jul 23 18:02:12.756233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.756105    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fb90b05-f9b1-409f-890e-111bd50340a8" containerName="registry"
Jul 23 18:02:12.756233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.756120    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc665070-5c0b-47f8-a149-0807c3327677" containerName="console"
Jul 23 18:02:12.756233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.756126    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc665070-5c0b-47f8-a149-0807c3327677" containerName="console"
Jul 23 18:02:12.756233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.756183    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fb90b05-f9b1-409f-890e-111bd50340a8" containerName="registry"
Jul 23 18:02:12.756233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.756194    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc665070-5c0b-47f8-a149-0807c3327677" containerName="console"
Jul 23 18:02:12.758103 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.758088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:12.768621 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.768601    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 18:02:12.768760 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.768602    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mhk4w\""
Jul 23 18:02:12.768760 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.768607    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 18:02:12.790396 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.790367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"]
Jul 23 18:02:12.844479 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.844445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrzcj\" (UniqueName: \"kubernetes.io/projected/56ec421f-04ad-484f-a351-e3ddf77bdd3d-kube-api-access-xrzcj\") pod \"cert-manager-cainjector-559cdd8c87-64qjl\" (UID: \"56ec421f-04ad-484f-a351-e3ddf77bdd3d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:12.844479 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.844476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56ec421f-04ad-484f-a351-e3ddf77bdd3d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-64qjl\" (UID: \"56ec421f-04ad-484f-a351-e3ddf77bdd3d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:12.945157 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.945126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrzcj\" (UniqueName: \"kubernetes.io/projected/56ec421f-04ad-484f-a351-e3ddf77bdd3d-kube-api-access-xrzcj\") pod \"cert-manager-cainjector-559cdd8c87-64qjl\" (UID: \"56ec421f-04ad-484f-a351-e3ddf77bdd3d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:12.945157 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.945157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56ec421f-04ad-484f-a351-e3ddf77bdd3d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-64qjl\" (UID: \"56ec421f-04ad-484f-a351-e3ddf77bdd3d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:12.961751 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.961727    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56ec421f-04ad-484f-a351-e3ddf77bdd3d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-64qjl\" (UID: \"56ec421f-04ad-484f-a351-e3ddf77bdd3d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:12.963080 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:12.963063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrzcj\" (UniqueName: \"kubernetes.io/projected/56ec421f-04ad-484f-a351-e3ddf77bdd3d-kube-api-access-xrzcj\") pod \"cert-manager-cainjector-559cdd8c87-64qjl\" (UID: \"56ec421f-04ad-484f-a351-e3ddf77bdd3d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:13.066846 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:13.066818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"
Jul 23 18:02:13.209401 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:13.209375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-64qjl"]
Jul 23 18:02:13.212456 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:02:13.212427    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56ec421f_04ad_484f_a351_e3ddf77bdd3d.slice/crio-d11ff27cc9019f9d025d1c8b731ab4b5704a683360f473a0c182414f6fc1e7c0 WatchSource:0}: Error finding container d11ff27cc9019f9d025d1c8b731ab4b5704a683360f473a0c182414f6fc1e7c0: Status 404 returned error can't find the container with id d11ff27cc9019f9d025d1c8b731ab4b5704a683360f473a0c182414f6fc1e7c0
Jul 23 18:02:13.421587 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:13.421520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl" event={"ID":"56ec421f-04ad-484f-a351-e3ddf77bdd3d","Type":"ContainerStarted","Data":"d11ff27cc9019f9d025d1c8b731ab4b5704a683360f473a0c182414f6fc1e7c0"}
Jul 23 18:02:16.436925 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:16.436893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl" event={"ID":"56ec421f-04ad-484f-a351-e3ddf77bdd3d","Type":"ContainerStarted","Data":"12c9c4a521ec38dd96da6cd142ab9a5526a63527a644318dae047076d73e28d2"}
Jul 23 18:02:16.458346 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:16.458298    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64qjl" podStartSLOduration=1.341367107 podStartE2EDuration="4.458282113s" totalImagesPullingTime="3.116915006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:16.45657854 +0000 UTC m=+297.712055766" watchObservedRunningTime="2026-07-23 18:02:16.458282113 +0000 UTC m=+297.713759340"
Jul 23 18:02:16.711836 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:16.711753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:17.151121 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:17.151089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:17.242169 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:17.242132    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:19.117503 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:19.117471    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:02:19.123715 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:19.123687    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:02:19.128164 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:19.128145    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 18:02:26.865763 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:26.865729    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jbbm5"]
Jul 23 18:02:26.867715 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:26.867698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:26.870311 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:26.870291    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9tzcg\""
Jul 23 18:02:26.887252 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:26.887231    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jbbm5"]
Jul 23 18:02:26.956515 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:26.956490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b822e6-6c8d-4f8b-8a2e-533385d55bfd-bound-sa-token\") pod \"cert-manager-55b4d954d5-jbbm5\" (UID: \"36b822e6-6c8d-4f8b-8a2e-533385d55bfd\") " pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:26.956628 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:26.956544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdn7l\" (UniqueName: \"kubernetes.io/projected/36b822e6-6c8d-4f8b-8a2e-533385d55bfd-kube-api-access-zdn7l\") pod \"cert-manager-55b4d954d5-jbbm5\" (UID: \"36b822e6-6c8d-4f8b-8a2e-533385d55bfd\") " pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:27.058076 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.058039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b822e6-6c8d-4f8b-8a2e-533385d55bfd-bound-sa-token\") pod \"cert-manager-55b4d954d5-jbbm5\" (UID: \"36b822e6-6c8d-4f8b-8a2e-533385d55bfd\") " pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:27.058207 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.058134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdn7l\" (UniqueName: \"kubernetes.io/projected/36b822e6-6c8d-4f8b-8a2e-533385d55bfd-kube-api-access-zdn7l\") pod \"cert-manager-55b4d954d5-jbbm5\" (UID: \"36b822e6-6c8d-4f8b-8a2e-533385d55bfd\") " pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:27.067469 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.067435    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdn7l\" (UniqueName: \"kubernetes.io/projected/36b822e6-6c8d-4f8b-8a2e-533385d55bfd-kube-api-access-zdn7l\") pod \"cert-manager-55b4d954d5-jbbm5\" (UID: \"36b822e6-6c8d-4f8b-8a2e-533385d55bfd\") " pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:27.067585 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.067444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36b822e6-6c8d-4f8b-8a2e-533385d55bfd-bound-sa-token\") pod \"cert-manager-55b4d954d5-jbbm5\" (UID: \"36b822e6-6c8d-4f8b-8a2e-533385d55bfd\") " pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:27.176422 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.176359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jbbm5"
Jul 23 18:02:27.307437 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.307409    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jbbm5"]
Jul 23 18:02:27.310228 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:02:27.310204    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36b822e6_6c8d_4f8b_8a2e_533385d55bfd.slice/crio-baac5d63e748231116c07bdbc539fdf0704d2d21d8de5da3dd1c61229ed80682 WatchSource:0}: Error finding container baac5d63e748231116c07bdbc539fdf0704d2d21d8de5da3dd1c61229ed80682: Status 404 returned error can't find the container with id baac5d63e748231116c07bdbc539fdf0704d2d21d8de5da3dd1c61229ed80682
Jul 23 18:02:27.479594 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.479511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jbbm5" event={"ID":"36b822e6-6c8d-4f8b-8a2e-533385d55bfd","Type":"ContainerStarted","Data":"22a1be05f58035ca2df61a74e2205ec45ff2b776d0547ab41faac27b3ecfbca7"}
Jul 23 18:02:27.479594 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.479549    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jbbm5" event={"ID":"36b822e6-6c8d-4f8b-8a2e-533385d55bfd","Type":"ContainerStarted","Data":"baac5d63e748231116c07bdbc539fdf0704d2d21d8de5da3dd1c61229ed80682"}
Jul 23 18:02:27.498201 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:27.498159    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jbbm5" podStartSLOduration=1.498144317 podStartE2EDuration="1.498144317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:27.497773385 +0000 UTC m=+308.753250621" watchObservedRunningTime="2026-07-23 18:02:27.498144317 +0000 UTC m=+308.753621542"
Jul 23 18:02:28.247788 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:28.247752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:28.345571 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:28.345536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:35.877368 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:35.877329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:35.977850 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:35.977803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:38.650326 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:38.650288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:40.440527 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:40.440495    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:40.510334 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:40.510304    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:49.585839 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:49.585808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:49.718601 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:49.718567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:50.440319 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:50.440283    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:50.860776 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:50.860744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:50.990094 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:50.990065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:51.111567 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.111498    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"]
Jul 23 18:02:51.116550 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.116531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.120231 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.120210    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 18:02:51.121199 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.121179    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z5mhz\""
Jul 23 18:02:51.121199 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.121188    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 18:02:51.121338 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.121243    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 18:02:51.121338 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.121188    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 18:02:51.140622 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.140603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"]
Jul 23 18:02:51.250130 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.250104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/043a2e63-e15b-47f1-87b8-e25188e22ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.250258 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.250139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/043a2e63-e15b-47f1-87b8-e25188e22ddb-manifests\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.250258 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.250170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/043a2e63-e15b-47f1-87b8-e25188e22ddb-tmp\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.250332 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.250255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/043a2e63-e15b-47f1-87b8-e25188e22ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.250332 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.250281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq99l\" (UniqueName: \"kubernetes.io/projected/043a2e63-e15b-47f1-87b8-e25188e22ddb-kube-api-access-rq99l\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.327222 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.327191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:51.351499 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.351472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/043a2e63-e15b-47f1-87b8-e25188e22ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.351608 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.351503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq99l\" (UniqueName: \"kubernetes.io/projected/043a2e63-e15b-47f1-87b8-e25188e22ddb-kube-api-access-rq99l\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.351608 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.351551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/043a2e63-e15b-47f1-87b8-e25188e22ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.351608 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.351572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/043a2e63-e15b-47f1-87b8-e25188e22ddb-manifests\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.351608 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.351599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/043a2e63-e15b-47f1-87b8-e25188e22ddb-tmp\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.352077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.352056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/043a2e63-e15b-47f1-87b8-e25188e22ddb-manifests\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.353843 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.353824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/043a2e63-e15b-47f1-87b8-e25188e22ddb-tmp\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.354401 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.354383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/043a2e63-e15b-47f1-87b8-e25188e22ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.354480 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.354405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/043a2e63-e15b-47f1-87b8-e25188e22ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.361365 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.361339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq99l\" (UniqueName: \"kubernetes.io/projected/043a2e63-e15b-47f1-87b8-e25188e22ddb-kube-api-access-rq99l\") pod \"opendatahub-operator-controller-manager-9f47b6774-6ksjc\" (UID: \"043a2e63-e15b-47f1-87b8-e25188e22ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.427343 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.427289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:51.435518 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.435491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:51.602091 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.602054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:51.602565 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.602542    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"]
Jul 23 18:02:51.606509 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:02:51.606483    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043a2e63_e15b_47f1_87b8_e25188e22ddb.slice/crio-ff12155bc4f1641b99d5dbaafe017afacb69769a63ee69e626ed3540ef2cccdb WatchSource:0}: Error finding container ff12155bc4f1641b99d5dbaafe017afacb69769a63ee69e626ed3540ef2cccdb: Status 404 returned error can't find the container with id ff12155bc4f1641b99d5dbaafe017afacb69769a63ee69e626ed3540ef2cccdb
Jul 23 18:02:51.608416 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.608399    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:02:51.709654 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.709593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:51.811077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.811050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:51.919279 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:51.919251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:52.579101 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:52.579059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc" event={"ID":"043a2e63-e15b-47f1-87b8-e25188e22ddb","Type":"ContainerStarted","Data":"ff12155bc4f1641b99d5dbaafe017afacb69769a63ee69e626ed3540ef2cccdb"}
Jul 23 18:02:55.599945 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:55.599886    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc" event={"ID":"043a2e63-e15b-47f1-87b8-e25188e22ddb","Type":"ContainerStarted","Data":"971cde485af9d2f3718d1d6c27d7504dbcb1057514c3fcc04e9528102c4f0157"}
Jul 23 18:02:56.605421 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:56.605385    2560 generic.go:356] "Generic (PLEG): container finished" podID="043a2e63-e15b-47f1-87b8-e25188e22ddb" containerID="971cde485af9d2f3718d1d6c27d7504dbcb1057514c3fcc04e9528102c4f0157" exitCode=0
Jul 23 18:02:56.605836 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:56.605475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc" event={"ID":"043a2e63-e15b-47f1-87b8-e25188e22ddb","Type":"ContainerDied","Data":"971cde485af9d2f3718d1d6c27d7504dbcb1057514c3fcc04e9528102c4f0157"}
Jul 23 18:02:58.615203 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:58.615162    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc" event={"ID":"043a2e63-e15b-47f1-87b8-e25188e22ddb","Type":"ContainerStarted","Data":"8c0444f1a37eb8260ee6c717d487bef97cac6d0842b3321b0d2d966a63f14272"}
Jul 23 18:02:58.615579 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:58.615308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:02:58.729620 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:02:58.729565    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc" podStartSLOduration=2.370449664 podStartE2EDuration="7.729546434s" totalImagesPullingTime="4.269147829s" totalInitContainerRuntime="1.089948941s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:58.726067392 +0000 UTC m=+339.981544619" watchObservedRunningTime="2026-07-23 18:02:58.729546434 +0000 UTC m=+339.985023656"
Jul 23 18:03:00.238191 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:00.238156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:00.931428 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:00.931393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:09.622543 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:09.622513    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-6ksjc"
Jul 23 18:03:10.001826 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:10.001739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:11.071545 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.071516    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"]
Jul 23 18:03:11.079664 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.079645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.085618 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.085593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 18:03:11.086211 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.085640    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b6cs4\""
Jul 23 18:03:11.086211 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.085748    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 18:03:11.086211 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.085911    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 18:03:11.086211 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.086017    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 18:03:11.086211 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.086156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:03:11.093271 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.093250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"]
Jul 23 18:03:11.111840 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.111816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d9b1939-475e-4ad0-b60c-6e0debda1729-cert\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.112004 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.111861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d9b1939-475e-4ad0-b60c-6e0debda1729-metrics-cert\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.112004 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.111895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d9b1939-475e-4ad0-b60c-6e0debda1729-manager-config\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.112004 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.111912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5td9\" (UniqueName: \"kubernetes.io/projected/6d9b1939-475e-4ad0-b60c-6e0debda1729-kube-api-access-j5td9\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.212451 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.212426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d9b1939-475e-4ad0-b60c-6e0debda1729-metrics-cert\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.212573 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.212461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d9b1939-475e-4ad0-b60c-6e0debda1729-manager-config\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.212573 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.212479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5td9\" (UniqueName: \"kubernetes.io/projected/6d9b1939-475e-4ad0-b60c-6e0debda1729-kube-api-access-j5td9\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.212573 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.212554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d9b1939-475e-4ad0-b60c-6e0debda1729-cert\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.213192 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.213170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d9b1939-475e-4ad0-b60c-6e0debda1729-manager-config\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.214955 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.214936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d9b1939-475e-4ad0-b60c-6e0debda1729-metrics-cert\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.215021 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.214974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d9b1939-475e-4ad0-b60c-6e0debda1729-cert\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.224002 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.223980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5td9\" (UniqueName: \"kubernetes.io/projected/6d9b1939-475e-4ad0-b60c-6e0debda1729-kube-api-access-j5td9\") pod \"lws-controller-manager-56f479bbd7-knwr7\" (UID: \"6d9b1939-475e-4ad0-b60c-6e0debda1729\") " pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.389048 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.388948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:11.543436 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.543408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"]
Jul 23 18:03:11.545908 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:03:11.545883    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9b1939_475e_4ad0_b60c_6e0debda1729.slice/crio-1f83ffb4f0f2b9746662073631f56cee697f74ed41487e8c009b2dfde49dbe7d WatchSource:0}: Error finding container 1f83ffb4f0f2b9746662073631f56cee697f74ed41487e8c009b2dfde49dbe7d: Status 404 returned error can't find the container with id 1f83ffb4f0f2b9746662073631f56cee697f74ed41487e8c009b2dfde49dbe7d
Jul 23 18:03:11.670184 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.670113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7" event={"ID":"6d9b1939-475e-4ad0-b60c-6e0debda1729","Type":"ContainerStarted","Data":"1f83ffb4f0f2b9746662073631f56cee697f74ed41487e8c009b2dfde49dbe7d"}
Jul 23 18:03:11.940435 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:11.940364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.183965 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:12.183934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.597202 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:12.597163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.780477 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:12.780399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.963079 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:12.962989    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:13.124639 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:13.124600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:13.301933 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:13.301900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:13.497813 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:13.497779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:14.364527 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:14.364495    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:14.687364 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:14.687273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7" event={"ID":"6d9b1939-475e-4ad0-b60c-6e0debda1729","Type":"ContainerStarted","Data":"1a47b2a56d4f63432e652c3587ac3f17004e1b120d1535d9cd202ff646f96fb9"}
Jul 23 18:03:14.687364 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:14.687357    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:14.758944 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:14.758885    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7" podStartSLOduration=1.3437659659999999 podStartE2EDuration="3.758870367s" totalImagesPullingTime="2.415104401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:14.757915745 +0000 UTC m=+356.013392972" watchObservedRunningTime="2026-07-23 18:03:14.758870367 +0000 UTC m=+356.014347592"
Jul 23 18:03:14.825321 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:14.825291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:16.037025 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:16.036992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:16.237521 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:16.237487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:18.382660 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:18.382614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:23.657851 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.657817    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"]
Jul 23 18:03:23.662767 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.662748    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.665931 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.665911    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 18:03:23.666974 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.666950    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 18:03:23.667177 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.666954    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 18:03:23.667177 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.666954    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vxbxt\""
Jul 23 18:03:23.667347 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.666957    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 18:03:23.667347 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.666963    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 18:03:23.667347 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.667043    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 18:03:23.682195 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.682172    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"]
Jul 23 18:03:23.724873 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.724849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39ee8c73-bb31-4171-8f04-f0396ef02e4a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.724980 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.724875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.724980 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.724899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f47h9\" (UniqueName: \"kubernetes.io/projected/39ee8c73-bb31-4171-8f04-f0396ef02e4a-kube-api-access-f47h9\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.724980 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.724933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.725139 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.725002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.725139 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.725022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.725139 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.725042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.825928 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.825900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.825928 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.825929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.826107 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.825956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.826107 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.825995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39ee8c73-bb31-4171-8f04-f0396ef02e4a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.826107 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.826021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.826107 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.826058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f47h9\" (UniqueName: \"kubernetes.io/projected/39ee8c73-bb31-4171-8f04-f0396ef02e4a-kube-api-access-f47h9\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.826307 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.826202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.826688 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.826651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.828296 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.828266    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39ee8c73-bb31-4171-8f04-f0396ef02e4a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.828451 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.828434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.828707 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.828667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.828774 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.828755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39ee8c73-bb31-4171-8f04-f0396ef02e4a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.841587 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.841555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39ee8c73-bb31-4171-8f04-f0396ef02e4a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.844648 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.844628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f47h9\" (UniqueName: \"kubernetes.io/projected/39ee8c73-bb31-4171-8f04-f0396ef02e4a-kube-api-access-f47h9\") pod \"istiod-openshift-gateway-94bb8fbfd-rnm2f\" (UID: \"39ee8c73-bb31-4171-8f04-f0396ef02e4a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:23.971879 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:23.971795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:24.129778 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:24.129746    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"]
Jul 23 18:03:24.133400 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:03:24.133373    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ee8c73_bb31_4171_8f04_f0396ef02e4a.slice/crio-0d8c3bbafcdadfc44a233a1f37eac62ebbf7896c0b68d99ae42faf377f1eff94 WatchSource:0}: Error finding container 0d8c3bbafcdadfc44a233a1f37eac62ebbf7896c0b68d99ae42faf377f1eff94: Status 404 returned error can't find the container with id 0d8c3bbafcdadfc44a233a1f37eac62ebbf7896c0b68d99ae42faf377f1eff94
Jul 23 18:03:24.730589 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:24.730527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f" event={"ID":"39ee8c73-bb31-4171-8f04-f0396ef02e4a","Type":"ContainerStarted","Data":"0d8c3bbafcdadfc44a233a1f37eac62ebbf7896c0b68d99ae42faf377f1eff94"}
Jul 23 18:03:25.694353 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:25.694323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56f479bbd7-knwr7"
Jul 23 18:03:25.718858 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:25.718825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:26.826452 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:26.826417    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 18:03:26.826732 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:26.826483    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 18:03:27.745595 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:27.745542    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f" event={"ID":"39ee8c73-bb31-4171-8f04-f0396ef02e4a","Type":"ContainerStarted","Data":"85ae4c4a56d9fc89c870e2c3526ccf76471849539ef751d76772929201fc70d8"}
Jul 23 18:03:27.745775 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:27.745620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:27.747199 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:27.747171    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-rnm2f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:03:27.747320 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:27.747220    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f" podUID="39ee8c73-bb31-4171-8f04-f0396ef02e4a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:03:28.092793 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:28.092760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:28.739694 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:28.739649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:28.751219 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:28.751194    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f"
Jul 23 18:03:28.836906 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:28.836857    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rnm2f" podStartSLOduration=3.145870373 podStartE2EDuration="5.836840296s" totalImagesPullingTime="2.690969923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:27.860437568 +0000 UTC m=+369.115914795" watchObservedRunningTime="2026-07-23 18:03:28.836840296 +0000 UTC m=+370.092317521"
Jul 23 18:03:28.903549 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:03:28.903517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:13.541386 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:13.541349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:13.642865 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:13.642814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:13.740330 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:13.740300    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:14.467501 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:14.467470    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:14.690071 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:14.690028    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:42.672640 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:42.672564    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:46.241488 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:46.241454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:47.519229 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.519196    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f8cb5fdc-ljvcz"]
Jul 23 18:04:47.522656 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.522635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.525291 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.525259    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 18:04:47.525529 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.525451    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z474v\""
Jul 23 18:04:47.526286 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.526262    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 18:04:47.526549 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.526529    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 18:04:47.527955 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.527940    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 18:04:47.528613 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.528591    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 18:04:47.539023 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.538998    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 18:04:47.539109 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.539092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f8cb5fdc-ljvcz"]
Jul 23 18:04:47.590994 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.590959    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:47.637253 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.637218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e7384e7-d747-43f8-977f-48a20500cfd1-console-oauth-config\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.637366 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.637258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-887lv\" (UniqueName: \"kubernetes.io/projected/6e7384e7-d747-43f8-977f-48a20500cfd1-kube-api-access-887lv\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.637366 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.637289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-trusted-ca-bundle\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.637366 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.637323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-oauth-serving-cert\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.637366 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.637345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e7384e7-d747-43f8-977f-48a20500cfd1-console-serving-cert\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.637366 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.637363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-console-config\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.637541 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.637417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-service-ca\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.688039 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.688010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:47.738020 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.737989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-oauth-serving-cert\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738109 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e7384e7-d747-43f8-977f-48a20500cfd1-console-serving-cert\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738109 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-console-config\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738109 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-service-ca\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738252 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e7384e7-d747-43f8-977f-48a20500cfd1-console-oauth-config\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738252 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-887lv\" (UniqueName: \"kubernetes.io/projected/6e7384e7-d747-43f8-977f-48a20500cfd1-kube-api-access-887lv\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738344 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-trusted-ca-bundle\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738849 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-oauth-serving-cert\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.738849 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.738857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-service-ca\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.739055 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.739007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-console-config\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.739132 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.739108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e7384e7-d747-43f8-977f-48a20500cfd1-trusted-ca-bundle\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.740588 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.740559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e7384e7-d747-43f8-977f-48a20500cfd1-console-oauth-config\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.740705 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.740620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e7384e7-d747-43f8-977f-48a20500cfd1-console-serving-cert\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.748436 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.748415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-887lv\" (UniqueName: \"kubernetes.io/projected/6e7384e7-d747-43f8-977f-48a20500cfd1-kube-api-access-887lv\") pod \"console-6f8cb5fdc-ljvcz\" (UID: \"6e7384e7-d747-43f8-977f-48a20500cfd1\") " pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.833766 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.833738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:47.986728 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:04:47.986697    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7384e7_d747_43f8_977f_48a20500cfd1.slice/crio-ee87457cfd9dbb2ee0412f1b3fdd3e7f0385477a04f8276b6859bd2b4a4686ca WatchSource:0}: Error finding container ee87457cfd9dbb2ee0412f1b3fdd3e7f0385477a04f8276b6859bd2b4a4686ca: Status 404 returned error can't find the container with id ee87457cfd9dbb2ee0412f1b3fdd3e7f0385477a04f8276b6859bd2b4a4686ca
Jul 23 18:04:47.987434 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:47.987408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f8cb5fdc-ljvcz"]
Jul 23 18:04:48.098661 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:48.098581    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8cb5fdc-ljvcz" event={"ID":"6e7384e7-d747-43f8-977f-48a20500cfd1","Type":"ContainerStarted","Data":"1e473a6cb8ca7c3c8cd4d8e488339495cabcedc9e406a1813dec1af8756a13ee"}
Jul 23 18:04:48.098661 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:48.098634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8cb5fdc-ljvcz" event={"ID":"6e7384e7-d747-43f8-977f-48a20500cfd1","Type":"ContainerStarted","Data":"ee87457cfd9dbb2ee0412f1b3fdd3e7f0385477a04f8276b6859bd2b4a4686ca"}
Jul 23 18:04:48.119414 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:48.119367    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f8cb5fdc-ljvcz" podStartSLOduration=1.119351827 podStartE2EDuration="1.119351827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:48.118385022 +0000 UTC m=+449.373862250" watchObservedRunningTime="2026-07-23 18:04:48.119351827 +0000 UTC m=+449.374829052"
Jul 23 18:04:48.793427 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:48.793393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:51.508911 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:51.508875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:51.674125 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:51.674090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:52.571158 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:52.571118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:54.147659 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:54.147627    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:54.279115 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:54.279081    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:55.062937 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:55.062903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:56.890235 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:56.890167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:57.833948 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:57.833910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:57.834116 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:57.833971    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:57.838614 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:57.838590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:58.149271 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:58.149186    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f8cb5fdc-ljvcz"
Jul 23 18:04:58.429286 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:58.429184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:58.595812 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:58.595779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:58.701013 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:58.700936    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:59.509301 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:59.509262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:59.686267 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:04:59.686219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:00.175273 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:00.175234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:00.334150 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:00.334113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:02.500167 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:02.500102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:02.602091 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:02.602058    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:08.666236 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:08.666194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:08.821176 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:08.821145    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:10.290187 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:10.290144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:10.399162 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:10.399131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:15.381292 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:15.381258    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:15.488468 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:15.488429    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:17.808805 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:17.808772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:17.921814 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:17.921780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:20.301272 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:20.301239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:20.389047 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:20.389015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:28.302317 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:28.302278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:28.408594 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:28.408560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:34.385911 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:34.385873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:34.463063 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:34.463030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:34.593467 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:34.593438    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:34.697621 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:34.697544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:41.397848 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:41.397811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:41.693629 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:41.693554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:43.138487 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.138443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:43.160180 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.160153    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"]
Jul 23 18:05:43.163459 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.163445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.168082 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.168059    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2dhdm\""
Jul 23 18:05:43.169065 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.169048    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 18:05:43.169156 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.169101    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 18:05:43.169229 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.169216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 18:05:43.184169 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.184148    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"]
Jul 23 18:05:43.201167 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.201142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f64d5\" (UniqueName: \"kubernetes.io/projected/048860a4-493d-458e-b829-85b88e8d4a12-kube-api-access-f64d5\") pod \"limitador-limitador-64c94fd64f-hf6ld\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.201293 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.201182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/048860a4-493d-458e-b829-85b88e8d4a12-config-file\") pod \"limitador-limitador-64c94fd64f-hf6ld\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.250309 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.250270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"]
Jul 23 18:05:43.267437 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.267409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:43.302329 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.302306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f64d5\" (UniqueName: \"kubernetes.io/projected/048860a4-493d-458e-b829-85b88e8d4a12-kube-api-access-f64d5\") pod \"limitador-limitador-64c94fd64f-hf6ld\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.302418 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.302342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/048860a4-493d-458e-b829-85b88e8d4a12-config-file\") pod \"limitador-limitador-64c94fd64f-hf6ld\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.302956 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.302939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/048860a4-493d-458e-b829-85b88e8d4a12-config-file\") pod \"limitador-limitador-64c94fd64f-hf6ld\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.312474 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.312454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f64d5\" (UniqueName: \"kubernetes.io/projected/048860a4-493d-458e-b829-85b88e8d4a12-kube-api-access-f64d5\") pod \"limitador-limitador-64c94fd64f-hf6ld\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.473419 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.473337    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:43.612922 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.612895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:43.618490 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:43.618462    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"]
Jul 23 18:05:43.621961 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:05:43.621936    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048860a4_493d_458e_b829_85b88e8d4a12.slice/crio-c9638eaa509f44bde8805fe3cdf7fe5e89d918487cd51cfc886567d6546fd3ef WatchSource:0}: Error finding container c9638eaa509f44bde8805fe3cdf7fe5e89d918487cd51cfc886567d6546fd3ef: Status 404 returned error can't find the container with id c9638eaa509f44bde8805fe3cdf7fe5e89d918487cd51cfc886567d6546fd3ef
Jul 23 18:05:44.142947 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:44.142897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:44.341374 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:44.341336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld" event={"ID":"048860a4-493d-458e-b829-85b88e8d4a12","Type":"ContainerStarted","Data":"c9638eaa509f44bde8805fe3cdf7fe5e89d918487cd51cfc886567d6546fd3ef"}
Jul 23 18:05:44.361312 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:44.361282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:47.355308 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:47.355270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld" event={"ID":"048860a4-493d-458e-b829-85b88e8d4a12","Type":"ContainerStarted","Data":"5ef39e5c64cb4df2c63657a58f4e298bb8b57f5f4cc18c77bdf913963cda449a"}
Jul 23 18:05:47.355741 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:47.355363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:47.379190 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:47.379141    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld" podStartSLOduration=1.61848916 podStartE2EDuration="4.379124707s" totalImagesPullingTime="2.760635547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:47.377761397 +0000 UTC m=+508.633238623" watchObservedRunningTime="2026-07-23 18:05:47.379124707 +0000 UTC m=+508.634601961"
Jul 23 18:05:58.360354 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:58.360325    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:58.464906 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:58.464873    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"]
Jul 23 18:05:58.465085 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:58.465056    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld" podUID="048860a4-493d-458e-b829-85b88e8d4a12" containerName="limitador" containerID="cri-o://5ef39e5c64cb4df2c63657a58f4e298bb8b57f5f4cc18c77bdf913963cda449a" gracePeriod=30
Jul 23 18:05:59.408402 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.408375    2560 generic.go:356] "Generic (PLEG): container finished" podID="048860a4-493d-458e-b829-85b88e8d4a12" containerID="5ef39e5c64cb4df2c63657a58f4e298bb8b57f5f4cc18c77bdf913963cda449a" exitCode=0
Jul 23 18:05:59.408814 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.408449    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld" event={"ID":"048860a4-493d-458e-b829-85b88e8d4a12","Type":"ContainerDied","Data":"5ef39e5c64cb4df2c63657a58f4e298bb8b57f5f4cc18c77bdf913963cda449a"}
Jul 23 18:05:59.408814 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.408505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld" event={"ID":"048860a4-493d-458e-b829-85b88e8d4a12","Type":"ContainerDied","Data":"c9638eaa509f44bde8805fe3cdf7fe5e89d918487cd51cfc886567d6546fd3ef"}
Jul 23 18:05:59.408814 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.408524    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9638eaa509f44bde8805fe3cdf7fe5e89d918487cd51cfc886567d6546fd3ef"
Jul 23 18:05:59.415278 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.415257    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:05:59.537273 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.537248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f64d5\" (UniqueName: \"kubernetes.io/projected/048860a4-493d-458e-b829-85b88e8d4a12-kube-api-access-f64d5\") pod \"048860a4-493d-458e-b829-85b88e8d4a12\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") "
Jul 23 18:05:59.537478 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.537327    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/048860a4-493d-458e-b829-85b88e8d4a12-config-file\") pod \"048860a4-493d-458e-b829-85b88e8d4a12\" (UID: \"048860a4-493d-458e-b829-85b88e8d4a12\") "
Jul 23 18:05:59.537649 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.537629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/048860a4-493d-458e-b829-85b88e8d4a12-config-file" (OuterVolumeSpecName: "config-file") pod "048860a4-493d-458e-b829-85b88e8d4a12" (UID: "048860a4-493d-458e-b829-85b88e8d4a12"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:05:59.539308 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.539285    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/048860a4-493d-458e-b829-85b88e8d4a12-kube-api-access-f64d5" (OuterVolumeSpecName: "kube-api-access-f64d5") pod "048860a4-493d-458e-b829-85b88e8d4a12" (UID: "048860a4-493d-458e-b829-85b88e8d4a12"). InnerVolumeSpecName "kube-api-access-f64d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:05:59.638494 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.638467    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f64d5\" (UniqueName: \"kubernetes.io/projected/048860a4-493d-458e-b829-85b88e8d4a12-kube-api-access-f64d5\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:05:59.638494 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:05:59.638490    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/048860a4-493d-458e-b829-85b88e8d4a12-config-file\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:06:00.412233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:00.412205    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"
Jul 23 18:06:00.451590 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:00.451564    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"]
Jul 23 18:06:00.464452 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:00.464427    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hf6ld"]
Jul 23 18:06:01.171645 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:01.171610    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="048860a4-493d-458e-b829-85b88e8d4a12" path="/var/lib/kubelet/pods/048860a4-493d-458e-b829-85b88e8d4a12/volumes"
Jul 23 18:06:04.766775 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.766741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:04.870341 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.870310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:04.982215 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.982179    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"]
Jul 23 18:06:04.982518 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.982506    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="048860a4-493d-458e-b829-85b88e8d4a12" containerName="limitador"
Jul 23 18:06:04.982568 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.982520    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="048860a4-493d-458e-b829-85b88e8d4a12" containerName="limitador"
Jul 23 18:06:04.982609 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.982580    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="048860a4-493d-458e-b829-85b88e8d4a12" containerName="limitador"
Jul 23 18:06:04.985770 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.985754    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:04.988570 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.988549    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:06:04.988570 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.988569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 18:06:04.988786 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.988613    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 18:06:04.989746 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.989729    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f4jvc\""
Jul 23 18:06:04.995254 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:04.995226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:05.000703 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.000667    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"]
Jul 23 18:06:05.081134 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.081108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eb8a72ff-e567-4ed2-b4ff-49a1e55bed56-data\") pod \"postgres-69fb4594cf-rjbsz\" (UID: \"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:05.081299 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.081142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75hq\" (UniqueName: \"kubernetes.io/projected/eb8a72ff-e567-4ed2-b4ff-49a1e55bed56-kube-api-access-g75hq\") pod \"postgres-69fb4594cf-rjbsz\" (UID: \"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:05.182147 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.182121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75hq\" (UniqueName: \"kubernetes.io/projected/eb8a72ff-e567-4ed2-b4ff-49a1e55bed56-kube-api-access-g75hq\") pod \"postgres-69fb4594cf-rjbsz\" (UID: \"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:05.182292 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.182246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eb8a72ff-e567-4ed2-b4ff-49a1e55bed56-data\") pod \"postgres-69fb4594cf-rjbsz\" (UID: \"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:05.182621 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.182604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eb8a72ff-e567-4ed2-b4ff-49a1e55bed56-data\") pod \"postgres-69fb4594cf-rjbsz\" (UID: \"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:05.192110 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.192087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75hq\" (UniqueName: \"kubernetes.io/projected/eb8a72ff-e567-4ed2-b4ff-49a1e55bed56-kube-api-access-g75hq\") pod \"postgres-69fb4594cf-rjbsz\" (UID: \"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:05.296021 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.295990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:05.443295 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:05.443266    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"]
Jul 23 18:06:05.446662 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:06:05.446631    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8a72ff_e567_4ed2_b4ff_49a1e55bed56.slice/crio-316ef11766c35ce14cd490faa0f465f54a29959192458f7f34810a7bb7e506bf WatchSource:0}: Error finding container 316ef11766c35ce14cd490faa0f465f54a29959192458f7f34810a7bb7e506bf: Status 404 returned error can't find the container with id 316ef11766c35ce14cd490faa0f465f54a29959192458f7f34810a7bb7e506bf
Jul 23 18:06:06.440475 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:06.440444    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz" event={"ID":"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56","Type":"ContainerStarted","Data":"316ef11766c35ce14cd490faa0f465f54a29959192458f7f34810a7bb7e506bf"}
Jul 23 18:06:09.827065 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:09.827021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:09.926561 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:09.926524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:11.472146 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:11.472032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz" event={"ID":"eb8a72ff-e567-4ed2-b4ff-49a1e55bed56","Type":"ContainerStarted","Data":"b114caf9072303bf97c544fa0760b53cae2d33a294ea65d96310ec1ad1b418df"}
Jul 23 18:06:11.472146 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:11.472092    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:11.495139 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:11.495092    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz" podStartSLOduration=1.846522006 podStartE2EDuration="7.495077164s" totalImagesPullingTime="5.648555158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:11.492353369 +0000 UTC m=+532.747830594" watchObservedRunningTime="2026-07-23 18:06:11.495077164 +0000 UTC m=+532.750554389"
Jul 23 18:06:17.506315 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:17.506285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rjbsz"
Jul 23 18:06:17.857528 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:17.857487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:17.967174 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:17.967122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:25.163788 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.163754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:25.195271 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.195243    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cbdf9bc5c-nzbbv"]
Jul 23 18:06:25.213073 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.213050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.216245 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.216215    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kwxzf\""
Jul 23 18:06:25.216380 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.216280    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:06:25.217243 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.217220    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:06:25.219505 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.219483    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cbdf9bc5c-nzbbv"]
Jul 23 18:06:25.272491 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.272454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:25.368313 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.368286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27b2z\" (UniqueName: \"kubernetes.io/projected/92c86e15-bed4-44c4-ae0d-177262f9541d-kube-api-access-27b2z\") pod \"maas-controller-5cbdf9bc5c-nzbbv\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") " pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.368438 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.368317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92c86e15-bed4-44c4-ae0d-177262f9541d-webhook-cert\") pod \"maas-controller-5cbdf9bc5c-nzbbv\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") " pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.373771 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.373745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:25.397545 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.397521    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cf75b947b-sf5wp"]
Jul 23 18:06:25.399733 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.399719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.417094 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.417046    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-sf5wp"]
Jul 23 18:06:25.453761 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.453739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:25.468909 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.468887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27b2z\" (UniqueName: \"kubernetes.io/projected/92c86e15-bed4-44c4-ae0d-177262f9541d-kube-api-access-27b2z\") pod \"maas-controller-5cbdf9bc5c-nzbbv\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") " pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.469111 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.468920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92c86e15-bed4-44c4-ae0d-177262f9541d-webhook-cert\") pod \"maas-controller-5cbdf9bc5c-nzbbv\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") " pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.471323 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.471300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92c86e15-bed4-44c4-ae0d-177262f9541d-webhook-cert\") pod \"maas-controller-5cbdf9bc5c-nzbbv\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") " pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.477538 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.477520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27b2z\" (UniqueName: \"kubernetes.io/projected/92c86e15-bed4-44c4-ae0d-177262f9541d-kube-api-access-27b2z\") pod \"maas-controller-5cbdf9bc5c-nzbbv\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") " pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.524520 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.524499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:25.569691 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.569644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs9zh\" (UniqueName: \"kubernetes.io/projected/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-kube-api-access-qs9zh\") pod \"maas-controller-6cf75b947b-sf5wp\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") " pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.569896 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.569810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-webhook-cert\") pod \"maas-controller-6cf75b947b-sf5wp\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") " pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.654562 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.654534    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cbdf9bc5c-nzbbv"]
Jul 23 18:06:25.656322 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:06:25.656290    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c86e15_bed4_44c4_ae0d_177262f9541d.slice/crio-d843341653f68e857733cd61d24bf360748e4b539a731233f346a8a63e5ba34a WatchSource:0}: Error finding container d843341653f68e857733cd61d24bf360748e4b539a731233f346a8a63e5ba34a: Status 404 returned error can't find the container with id d843341653f68e857733cd61d24bf360748e4b539a731233f346a8a63e5ba34a
Jul 23 18:06:25.670591 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.670537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs9zh\" (UniqueName: \"kubernetes.io/projected/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-kube-api-access-qs9zh\") pod \"maas-controller-6cf75b947b-sf5wp\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") " pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.670705 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.670642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-webhook-cert\") pod \"maas-controller-6cf75b947b-sf5wp\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") " pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.672840 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.672821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-webhook-cert\") pod \"maas-controller-6cf75b947b-sf5wp\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") " pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.679072 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.679054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs9zh\" (UniqueName: \"kubernetes.io/projected/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-kube-api-access-qs9zh\") pod \"maas-controller-6cf75b947b-sf5wp\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") " pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.709628 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.709605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:25.840724 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:25.840697    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-sf5wp"]
Jul 23 18:06:25.843210 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:06:25.843186    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6faaedb2_cab3_4c2e_85c1_c71fbbec7012.slice/crio-ae5be20de64eb160759977e480504e81ce51b465cd6e17e3c4e3935468f0ff7a WatchSource:0}: Error finding container ae5be20de64eb160759977e480504e81ce51b465cd6e17e3c4e3935468f0ff7a: Status 404 returned error can't find the container with id ae5be20de64eb160759977e480504e81ce51b465cd6e17e3c4e3935468f0ff7a
Jul 23 18:06:26.545604 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:26.545524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-sf5wp" event={"ID":"6faaedb2-cab3-4c2e-85c1-c71fbbec7012","Type":"ContainerStarted","Data":"ae5be20de64eb160759977e480504e81ce51b465cd6e17e3c4e3935468f0ff7a"}
Jul 23 18:06:26.547163 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:26.547080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv" event={"ID":"92c86e15-bed4-44c4-ae0d-177262f9541d","Type":"ContainerStarted","Data":"d843341653f68e857733cd61d24bf360748e4b539a731233f346a8a63e5ba34a"}
Jul 23 18:06:28.490620 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.490587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:28.558282 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.558249    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-sf5wp" event={"ID":"6faaedb2-cab3-4c2e-85c1-c71fbbec7012","Type":"ContainerStarted","Data":"a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af"}
Jul 23 18:06:28.558426 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.558374    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:28.559655 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.559634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv" event={"ID":"92c86e15-bed4-44c4-ae0d-177262f9541d","Type":"ContainerStarted","Data":"d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb"}
Jul 23 18:06:28.559773 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.559713    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:28.600185 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.600142    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cf75b947b-sf5wp" podStartSLOduration=1.172405275 podStartE2EDuration="3.60012882s" totalImagesPullingTime="2.427723545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:28.599932503 +0000 UTC m=+549.855409729" watchObservedRunningTime="2026-07-23 18:06:28.60012882 +0000 UTC m=+549.855606046"
Jul 23 18:06:28.606025 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.605986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:28.641136 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:28.641091    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv" podStartSLOduration=1.021038042 podStartE2EDuration="3.641078995s" totalImagesPullingTime="2.620040953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:28.63962323 +0000 UTC m=+549.895100456" watchObservedRunningTime="2026-07-23 18:06:28.641078995 +0000 UTC m=+549.896556221"
Jul 23 18:06:39.566592 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.566555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:39.567064 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.566637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:06:39.644583 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.644504    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cbdf9bc5c-nzbbv"]
Jul 23 18:06:39.644820 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.644785    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv" podUID="92c86e15-bed4-44c4-ae0d-177262f9541d" containerName="manager" containerID="cri-o://d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb" gracePeriod=30
Jul 23 18:06:39.893896 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.893872    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:39.991154 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.991113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92c86e15-bed4-44c4-ae0d-177262f9541d-webhook-cert\") pod \"92c86e15-bed4-44c4-ae0d-177262f9541d\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") "
Jul 23 18:06:39.991339 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.991226    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27b2z\" (UniqueName: \"kubernetes.io/projected/92c86e15-bed4-44c4-ae0d-177262f9541d-kube-api-access-27b2z\") pod \"92c86e15-bed4-44c4-ae0d-177262f9541d\" (UID: \"92c86e15-bed4-44c4-ae0d-177262f9541d\") "
Jul 23 18:06:39.993388 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.993361    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c86e15-bed4-44c4-ae0d-177262f9541d-kube-api-access-27b2z" (OuterVolumeSpecName: "kube-api-access-27b2z") pod "92c86e15-bed4-44c4-ae0d-177262f9541d" (UID: "92c86e15-bed4-44c4-ae0d-177262f9541d"). InnerVolumeSpecName "kube-api-access-27b2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:06:39.993494 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:39.993383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c86e15-bed4-44c4-ae0d-177262f9541d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "92c86e15-bed4-44c4-ae0d-177262f9541d" (UID: "92c86e15-bed4-44c4-ae0d-177262f9541d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:06:40.092224 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.092189    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92c86e15-bed4-44c4-ae0d-177262f9541d-webhook-cert\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:06:40.092224 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.092220    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27b2z\" (UniqueName: \"kubernetes.io/projected/92c86e15-bed4-44c4-ae0d-177262f9541d-kube-api-access-27b2z\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:06:40.613364 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.613326    2560 generic.go:356] "Generic (PLEG): container finished" podID="92c86e15-bed4-44c4-ae0d-177262f9541d" containerID="d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb" exitCode=0
Jul 23 18:06:40.613768 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.613370    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv"
Jul 23 18:06:40.613768 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.613412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv" event={"ID":"92c86e15-bed4-44c4-ae0d-177262f9541d","Type":"ContainerDied","Data":"d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb"}
Jul 23 18:06:40.613768 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.613466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbdf9bc5c-nzbbv" event={"ID":"92c86e15-bed4-44c4-ae0d-177262f9541d","Type":"ContainerDied","Data":"d843341653f68e857733cd61d24bf360748e4b539a731233f346a8a63e5ba34a"}
Jul 23 18:06:40.613768 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.613489    2560 scope.go:117] "RemoveContainer" containerID="d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb"
Jul 23 18:06:40.622569 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.622549    2560 scope.go:117] "RemoveContainer" containerID="d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb"
Jul 23 18:06:40.622837 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:06:40.622819    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb\": container with ID starting with d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb not found: ID does not exist" containerID="d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb"
Jul 23 18:06:40.622898 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.622849    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb"} err="failed to get container status \"d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb\": rpc error: code = NotFound desc = could not find container \"d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb\": container with ID starting with d784e81d1700390036f1a7417ee5c517c7a6a6e5e3af6c1b1013af60acfb81bb not found: ID does not exist"
Jul 23 18:06:40.636357 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.636299    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cbdf9bc5c-nzbbv"]
Jul 23 18:06:40.638460 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:40.638437    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cbdf9bc5c-nzbbv"]
Jul 23 18:06:41.171975 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:41.171945    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92c86e15-bed4-44c4-ae0d-177262f9541d" path="/var/lib/kubelet/pods/92c86e15-bed4-44c4-ae0d-177262f9541d/volumes"
Jul 23 18:06:48.303861 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:48.303816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:06:48.385272 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:06:48.385233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:01.437007 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.436972    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"]
Jul 23 18:07:01.437380 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.437308    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92c86e15-bed4-44c4-ae0d-177262f9541d" containerName="manager"
Jul 23 18:07:01.437380 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.437318    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="92c86e15-bed4-44c4-ae0d-177262f9541d" containerName="manager"
Jul 23 18:07:01.437456 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.437387    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="92c86e15-bed4-44c4-ae0d-177262f9541d" containerName="manager"
Jul 23 18:07:01.440647 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.440629    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.445178 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.445156    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n5q7f\""
Jul 23 18:07:01.445305 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.445157    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 18:07:01.460334 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.460304    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"]
Jul 23 18:07:01.467053 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.467027    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:01.561059 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.561013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:01.578305 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.578271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv6q2\" (UniqueName: \"kubernetes.io/projected/a402ae06-bef1-47bb-a12e-ff6f81453880-kube-api-access-gv6q2\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.578428 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.578319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a402ae06-bef1-47bb-a12e-ff6f81453880-openshift-service-ca\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.578428 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.578354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a402ae06-bef1-47bb-a12e-ff6f81453880-maas-api-tls\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.678855 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.678807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv6q2\" (UniqueName: \"kubernetes.io/projected/a402ae06-bef1-47bb-a12e-ff6f81453880-kube-api-access-gv6q2\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.679036 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.678873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a402ae06-bef1-47bb-a12e-ff6f81453880-openshift-service-ca\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.679036 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.678929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a402ae06-bef1-47bb-a12e-ff6f81453880-maas-api-tls\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.679529 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.679505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a402ae06-bef1-47bb-a12e-ff6f81453880-openshift-service-ca\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.681345 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.681326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a402ae06-bef1-47bb-a12e-ff6f81453880-maas-api-tls\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.704358 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.704289    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv6q2\" (UniqueName: \"kubernetes.io/projected/a402ae06-bef1-47bb-a12e-ff6f81453880-kube-api-access-gv6q2\") pod \"maas-api-5dbbf89774-7szs9\" (UID: \"a402ae06-bef1-47bb-a12e-ff6f81453880\") " pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.750505 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.750471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:01.912551 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:01.912525    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"]
Jul 23 18:07:01.913833 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:07:01.913806    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda402ae06_bef1_47bb_a12e_ff6f81453880.slice/crio-62f19ab6125fda8d1031120eb3a4d1ca9ae76f93f5e809ee2f5c9c562f271fd5 WatchSource:0}: Error finding container 62f19ab6125fda8d1031120eb3a4d1ca9ae76f93f5e809ee2f5c9c562f271fd5: Status 404 returned error can't find the container with id 62f19ab6125fda8d1031120eb3a4d1ca9ae76f93f5e809ee2f5c9c562f271fd5
Jul 23 18:07:02.271531 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.271497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:02.413510 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.413478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:02.497432 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.497401    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"]
Jul 23 18:07:02.503473 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.503449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.514909 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.514887    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 18:07:02.515044 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.514887    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-494hl\""
Jul 23 18:07:02.541989 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.538578    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"]
Jul 23 18:07:02.584913 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.584878    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hwfn6"]
Jul 23 18:07:02.587719 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.587690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz68w\" (UniqueName: \"kubernetes.io/projected/156b94bc-8345-49f2-a6c8-7e48725bbe31-kube-api-access-jz68w\") pod \"payload-pre-processing-7677b774bb-mvm4g\" (UID: \"156b94bc-8345-49f2-a6c8-7e48725bbe31\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.587864 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.587778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156b94bc-8345-49f2-a6c8-7e48725bbe31-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mvm4g\" (UID: \"156b94bc-8345-49f2-a6c8-7e48725bbe31\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.588967 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.588937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.601245 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.601214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hwfn6"]
Jul 23 18:07:02.688450 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.688403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m244\" (UniqueName: \"kubernetes.io/projected/0f91ff38-3352-4dfb-b4b0-8f470c6db5a1-kube-api-access-5m244\") pod \"payload-processing-5bf47cd988-hwfn6\" (UID: \"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1\") " pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.688902 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.688454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156b94bc-8345-49f2-a6c8-7e48725bbe31-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mvm4g\" (UID: \"156b94bc-8345-49f2-a6c8-7e48725bbe31\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.688902 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.688600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz68w\" (UniqueName: \"kubernetes.io/projected/156b94bc-8345-49f2-a6c8-7e48725bbe31-kube-api-access-jz68w\") pod \"payload-pre-processing-7677b774bb-mvm4g\" (UID: \"156b94bc-8345-49f2-a6c8-7e48725bbe31\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.688902 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.688704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f91ff38-3352-4dfb-b4b0-8f470c6db5a1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hwfn6\" (UID: \"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1\") " pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.689467 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.689440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/156b94bc-8345-49f2-a6c8-7e48725bbe31-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mvm4g\" (UID: \"156b94bc-8345-49f2-a6c8-7e48725bbe31\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.700938 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.700910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz68w\" (UniqueName: \"kubernetes.io/projected/156b94bc-8345-49f2-a6c8-7e48725bbe31-kube-api-access-jz68w\") pod \"payload-pre-processing-7677b774bb-mvm4g\" (UID: \"156b94bc-8345-49f2-a6c8-7e48725bbe31\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.720757 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.720709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9" event={"ID":"a402ae06-bef1-47bb-a12e-ff6f81453880","Type":"ContainerStarted","Data":"62f19ab6125fda8d1031120eb3a4d1ca9ae76f93f5e809ee2f5c9c562f271fd5"}
Jul 23 18:07:02.789889 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.789851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f91ff38-3352-4dfb-b4b0-8f470c6db5a1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hwfn6\" (UID: \"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1\") " pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.790083 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.789897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m244\" (UniqueName: \"kubernetes.io/projected/0f91ff38-3352-4dfb-b4b0-8f470c6db5a1-kube-api-access-5m244\") pod \"payload-processing-5bf47cd988-hwfn6\" (UID: \"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1\") " pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.790685 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.790642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f91ff38-3352-4dfb-b4b0-8f470c6db5a1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hwfn6\" (UID: \"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1\") " pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.804505 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.804434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m244\" (UniqueName: \"kubernetes.io/projected/0f91ff38-3352-4dfb-b4b0-8f470c6db5a1-kube-api-access-5m244\") pod \"payload-processing-5bf47cd988-hwfn6\" (UID: \"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1\") " pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.814825 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.814103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:02.903094 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.903060    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:02.991251 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:02.991224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"]
Jul 23 18:07:02.993269 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:07:02.993240    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156b94bc_8345_49f2_a6c8_7e48725bbe31.slice/crio-e9d858e2ce4cd5d15f9d9b6f3895b918251c3869c4fe2a788e71a78efd5d3ed6 WatchSource:0}: Error finding container e9d858e2ce4cd5d15f9d9b6f3895b918251c3869c4fe2a788e71a78efd5d3ed6: Status 404 returned error can't find the container with id e9d858e2ce4cd5d15f9d9b6f3895b918251c3869c4fe2a788e71a78efd5d3ed6
Jul 23 18:07:03.083951 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:03.083917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hwfn6"]
Jul 23 18:07:03.351993 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:07:03.351908    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f91ff38_3352_4dfb_b4b0_8f470c6db5a1.slice/crio-4442896c0a0dc548ec10d094946cf9da0f7b78631d9261e9f17ca834d891f272 WatchSource:0}: Error finding container 4442896c0a0dc548ec10d094946cf9da0f7b78631d9261e9f17ca834d891f272: Status 404 returned error can't find the container with id 4442896c0a0dc548ec10d094946cf9da0f7b78631d9261e9f17ca834d891f272
Jul 23 18:07:03.727088 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:03.727007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9" event={"ID":"a402ae06-bef1-47bb-a12e-ff6f81453880","Type":"ContainerStarted","Data":"54c96815554feec532875d01bc111718fd47fd38b768e4db6bcb9a3cf3b58322"}
Jul 23 18:07:03.727513 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:03.727098    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:03.728270 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:03.728245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g" event={"ID":"156b94bc-8345-49f2-a6c8-7e48725bbe31","Type":"ContainerStarted","Data":"e9d858e2ce4cd5d15f9d9b6f3895b918251c3869c4fe2a788e71a78efd5d3ed6"}
Jul 23 18:07:03.729272 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:03.729244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6" event={"ID":"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1","Type":"ContainerStarted","Data":"4442896c0a0dc548ec10d094946cf9da0f7b78631d9261e9f17ca834d891f272"}
Jul 23 18:07:03.751166 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:03.751118    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9" podStartSLOduration=1.268133358 podStartE2EDuration="2.751100426s" totalImagesPullingTime="1.482967068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:03.74883771 +0000 UTC m=+585.004314936" watchObservedRunningTime="2026-07-23 18:07:03.751100426 +0000 UTC m=+585.006577652"
Jul 23 18:07:05.743704 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:05.743596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g" event={"ID":"156b94bc-8345-49f2-a6c8-7e48725bbe31","Type":"ContainerStarted","Data":"893de869b9920b4cd80f964f821ebb571fc94387864536d6ebcee8ce7df9d169"}
Jul 23 18:07:05.744146 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:05.743769    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:05.745331 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:05.745302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6" event={"ID":"0f91ff38-3352-4dfb-b4b0-8f470c6db5a1","Type":"ContainerStarted","Data":"45eb4bdd320c4860d75ece274dc2df0dbb100cb4c4a1b8831f15d528659f2ccd"}
Jul 23 18:07:05.745465 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:05.745457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:05.769470 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:05.769411    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g" podStartSLOduration=1.1280745699999999 podStartE2EDuration="3.769395553s" totalImagesPullingTime="2.641320983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:05.766490997 +0000 UTC m=+587.021968224" watchObservedRunningTime="2026-07-23 18:07:05.769395553 +0000 UTC m=+587.024872779"
Jul 23 18:07:09.741432 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:09.741403    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5dbbf89774-7szs9"
Jul 23 18:07:09.776141 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:09.776085    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6" podStartSLOduration=5.526225987 podStartE2EDuration="7.776066916s" totalImagesPullingTime="2.249840929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:05.796101024 +0000 UTC m=+587.051578253" watchObservedRunningTime="2026-07-23 18:07:09.776066916 +0000 UTC m=+591.031544148"
Jul 23 18:07:11.454383 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:11.454346    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:11.553654 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:11.553625    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:16.752591 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:16.752560    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-hwfn6"
Jul 23 18:07:16.752990 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:16.752633    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-mvm4g"
Jul 23 18:07:16.770218 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:16.770186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:18.511817 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:18.511787    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:19.148618 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:19.148588    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:07:19.150882 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:19.150857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:07:22.408450 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.408412    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"]
Jul 23 18:07:22.413059 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.413043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.416243 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.416216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 18:07:22.416493 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.416476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 18:07:22.416579 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.416480    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jxkjt\""
Jul 23 18:07:22.416579 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.416510    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 18:07:22.455578 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.455521    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"]
Jul 23 18:07:22.464824 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.464801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.464955 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.464865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.464955 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.464947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djjm\" (UniqueName: \"kubernetes.io/projected/0bab693c-5342-4f37-8022-ed2938693897-kube-api-access-2djjm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.465077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.464988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.465077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.465016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.465077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.465051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bab693c-5342-4f37-8022-ed2938693897-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.502178 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.502144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:22.565888 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.565853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566043 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.565921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566043 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.565971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2djjm\" (UniqueName: \"kubernetes.io/projected/0bab693c-5342-4f37-8022-ed2938693897-kube-api-access-2djjm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566043 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.566009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566043 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.566035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.566060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bab693c-5342-4f37-8022-ed2938693897-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566328 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.566306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566388 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.566331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.566388 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.566307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.568101 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.568072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bab693c-5342-4f37-8022-ed2938693897-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.568466 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.568446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bab693c-5342-4f37-8022-ed2938693897-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.574652 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.574633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djjm\" (UniqueName: \"kubernetes.io/projected/0bab693c-5342-4f37-8022-ed2938693897-kube-api-access-2djjm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bksxx\" (UID: \"0bab693c-5342-4f37-8022-ed2938693897\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.723833 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.723758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:22.864629 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:22.864606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"]
Jul 23 18:07:22.866923 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:07:22.866902    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bab693c_5342_4f37_8022_ed2938693897.slice/crio-18997bad80cc51e6d80b6e2a852f81a354ccb0dde8e913d799436396724551bd WatchSource:0}: Error finding container 18997bad80cc51e6d80b6e2a852f81a354ccb0dde8e913d799436396724551bd: Status 404 returned error can't find the container with id 18997bad80cc51e6d80b6e2a852f81a354ccb0dde8e913d799436396724551bd
Jul 23 18:07:23.839825 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:23.839793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx" event={"ID":"0bab693c-5342-4f37-8022-ed2938693897","Type":"ContainerStarted","Data":"18997bad80cc51e6d80b6e2a852f81a354ccb0dde8e913d799436396724551bd"}
Jul 23 18:07:24.845722 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:24.845664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx" event={"ID":"0bab693c-5342-4f37-8022-ed2938693897","Type":"ContainerStarted","Data":"5b6ea9b5ae952b49b6f712c8566c773f4fcca7df59b65141edc0af695f7efebb"}
Jul 23 18:07:28.120693 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:28.120634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:32.724152 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:32.724116    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:32.724537 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:32.724181    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:32.736808 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:32.736784    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:32.764468 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:32.764425    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx" podStartSLOduration=9.72669298 podStartE2EDuration="10.764410457s" totalImagesPullingTime="1.037717477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:24.883456147 +0000 UTC m=+606.138933374" watchObservedRunningTime="2026-07-23 18:07:32.764410457 +0000 UTC m=+614.019887682"
Jul 23 18:07:32.893187 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:32.893163    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bksxx"
Jul 23 18:07:41.729464 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:41.729387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:54.298339 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.298303    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"]
Jul 23 18:07:54.305277 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.305255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.309028 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.309002    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 18:07:54.316746 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.316724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"]
Jul 23 18:07:54.352746 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.352716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:54.461378 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.461338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.461378 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.461396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.461616 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.461477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652cd22d-70a3-4136-8c6a-f403506a2110-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.461616 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.461532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhj42\" (UniqueName: \"kubernetes.io/projected/652cd22d-70a3-4136-8c6a-f403506a2110-kube-api-access-vhj42\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.461616 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.461558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.461616 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.461575    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.562745 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.562647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652cd22d-70a3-4136-8c6a-f403506a2110-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.562745 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.562746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhj42\" (UniqueName: \"kubernetes.io/projected/652cd22d-70a3-4136-8c6a-f403506a2110-kube-api-access-vhj42\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.562975 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.562773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.562975 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.562793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.562975 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.562897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.562975 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.562932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.563290 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.563260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.563417 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.563271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.563417 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.563327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.565091 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.565065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652cd22d-70a3-4136-8c6a-f403506a2110-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.565192 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.565171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652cd22d-70a3-4136-8c6a-f403506a2110-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.571899 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.571876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhj42\" (UniqueName: \"kubernetes.io/projected/652cd22d-70a3-4136-8c6a-f403506a2110-kube-api-access-vhj42\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bz6lr\" (UID: \"652cd22d-70a3-4136-8c6a-f403506a2110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.616332 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.616293    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:07:54.762032 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.762007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"]
Jul 23 18:07:54.764618 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:07:54.764577    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652cd22d_70a3_4136_8c6a_f403506a2110.slice/crio-d36befcebf6623cf5c47b9b329f9f9cc440a148a6f4f0e3d28389915577c8b0e WatchSource:0}: Error finding container d36befcebf6623cf5c47b9b329f9f9cc440a148a6f4f0e3d28389915577c8b0e: Status 404 returned error can't find the container with id d36befcebf6623cf5c47b9b329f9f9cc440a148a6f4f0e3d28389915577c8b0e
Jul 23 18:07:54.766278 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.766257    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:07:54.984455 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:54.984429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr" event={"ID":"652cd22d-70a3-4136-8c6a-f403506a2110","Type":"ContainerStarted","Data":"d36befcebf6623cf5c47b9b329f9f9cc440a148a6f4f0e3d28389915577c8b0e"}
Jul 23 18:07:55.260298 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:55.260218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:55.990754 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:55.990719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr" event={"ID":"652cd22d-70a3-4136-8c6a-f403506a2110","Type":"ContainerStarted","Data":"3b06719c3158896d3e092ee95cc54d594d0b3ee3accdcec0e72b8505b9121e63"}
Jul 23 18:07:56.014665 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:07:56.014609    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr" podStartSLOduration=1.802470657 podStartE2EDuration="2.014589277s" totalImagesPullingTime="212.11862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:56.013531053 +0000 UTC m=+637.269008282" watchObservedRunningTime="2026-07-23 18:07:56.014589277 +0000 UTC m=+637.270066547"
Jul 23 18:08:04.616924 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:04.616878    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:08:04.617340 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:04.616950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:08:04.629890 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:04.629867    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:08:05.046159 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:05.046133    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bz6lr"
Jul 23 18:08:08.980985 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:08.980949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:51.850693 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:51.850646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:53.112746 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:53.112714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:53.249844 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:08:53.249808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:39.589831 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:39.589790    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-sf5wp"]
Jul 23 18:09:39.590435 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:39.589989    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cf75b947b-sf5wp" podUID="6faaedb2-cab3-4c2e-85c1-c71fbbec7012" containerName="manager" containerID="cri-o://a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af" gracePeriod=30
Jul 23 18:09:39.842934 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:39.842874    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:09:39.925049 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:39.925021    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-webhook-cert\") pod \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") "
Jul 23 18:09:39.925203 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:39.925131    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs9zh\" (UniqueName: \"kubernetes.io/projected/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-kube-api-access-qs9zh\") pod \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\" (UID: \"6faaedb2-cab3-4c2e-85c1-c71fbbec7012\") "
Jul 23 18:09:39.926939 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:39.926912    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6faaedb2-cab3-4c2e-85c1-c71fbbec7012" (UID: "6faaedb2-cab3-4c2e-85c1-c71fbbec7012"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:09:39.927084 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:39.927066    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-kube-api-access-qs9zh" (OuterVolumeSpecName: "kube-api-access-qs9zh") pod "6faaedb2-cab3-4c2e-85c1-c71fbbec7012" (UID: "6faaedb2-cab3-4c2e-85c1-c71fbbec7012"). InnerVolumeSpecName "kube-api-access-qs9zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:09:40.026242 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.026206    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-webhook-cert\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:09:40.026242 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.026235    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs9zh\" (UniqueName: \"kubernetes.io/projected/6faaedb2-cab3-4c2e-85c1-c71fbbec7012-kube-api-access-qs9zh\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:09:40.495489 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.495451    2560 generic.go:356] "Generic (PLEG): container finished" podID="6faaedb2-cab3-4c2e-85c1-c71fbbec7012" containerID="a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af" exitCode=0
Jul 23 18:09:40.495668 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.495499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-sf5wp" event={"ID":"6faaedb2-cab3-4c2e-85c1-c71fbbec7012","Type":"ContainerDied","Data":"a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af"}
Jul 23 18:09:40.495668 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.495512    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-sf5wp"
Jul 23 18:09:40.495668 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.495534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-sf5wp" event={"ID":"6faaedb2-cab3-4c2e-85c1-c71fbbec7012","Type":"ContainerDied","Data":"ae5be20de64eb160759977e480504e81ce51b465cd6e17e3c4e3935468f0ff7a"}
Jul 23 18:09:40.495668 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.495555    2560 scope.go:117] "RemoveContainer" containerID="a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af"
Jul 23 18:09:40.506579 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.506555    2560 scope.go:117] "RemoveContainer" containerID="a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af"
Jul 23 18:09:40.507086 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:09:40.507060    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af\": container with ID starting with a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af not found: ID does not exist" containerID="a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af"
Jul 23 18:09:40.507173 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.507098    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af"} err="failed to get container status \"a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af\": rpc error: code = NotFound desc = could not find container \"a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af\": container with ID starting with a3b78ddd356886d75a4cf55e7cc23e6de938a10d8426fa072fef5f88d3b651af not found: ID does not exist"
Jul 23 18:09:40.517827 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.517800    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-sf5wp"]
Jul 23 18:09:40.520074 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.520055    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-sf5wp"]
Jul 23 18:09:40.660747 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:40.660712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:41.172314 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:41.172284    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6faaedb2-cab3-4c2e-85c1-c71fbbec7012" path="/var/lib/kubelet/pods/6faaedb2-cab3-4c2e-85c1-c71fbbec7012/volumes"
Jul 23 18:09:56.869823 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:09:56.869790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:41.345165 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.345128    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cf75b947b-q8dgf"]
Jul 23 18:10:41.345597 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.345474    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6faaedb2-cab3-4c2e-85c1-c71fbbec7012" containerName="manager"
Jul 23 18:10:41.345597 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.345486    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6faaedb2-cab3-4c2e-85c1-c71fbbec7012" containerName="manager"
Jul 23 18:10:41.345597 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.345565    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6faaedb2-cab3-4c2e-85c1-c71fbbec7012" containerName="manager"
Jul 23 18:10:41.349810 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.349794    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.353614 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.353589    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kwxzf\""
Jul 23 18:10:41.353784 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.353627    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:10:41.353784 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.353648    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:10:41.361072 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.361049    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-q8dgf"]
Jul 23 18:10:41.463087 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.463013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3362698-b648-4171-960f-17efea458274-webhook-cert\") pod \"maas-controller-6cf75b947b-q8dgf\" (UID: \"c3362698-b648-4171-960f-17efea458274\") " pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.463087 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.463072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzrzn\" (UniqueName: \"kubernetes.io/projected/c3362698-b648-4171-960f-17efea458274-kube-api-access-pzrzn\") pod \"maas-controller-6cf75b947b-q8dgf\" (UID: \"c3362698-b648-4171-960f-17efea458274\") " pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.563473 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.563442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzrzn\" (UniqueName: \"kubernetes.io/projected/c3362698-b648-4171-960f-17efea458274-kube-api-access-pzrzn\") pod \"maas-controller-6cf75b947b-q8dgf\" (UID: \"c3362698-b648-4171-960f-17efea458274\") " pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.563613 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.563514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3362698-b648-4171-960f-17efea458274-webhook-cert\") pod \"maas-controller-6cf75b947b-q8dgf\" (UID: \"c3362698-b648-4171-960f-17efea458274\") " pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.565833 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.565812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3362698-b648-4171-960f-17efea458274-webhook-cert\") pod \"maas-controller-6cf75b947b-q8dgf\" (UID: \"c3362698-b648-4171-960f-17efea458274\") " pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.572884 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.572863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzrzn\" (UniqueName: \"kubernetes.io/projected/c3362698-b648-4171-960f-17efea458274-kube-api-access-pzrzn\") pod \"maas-controller-6cf75b947b-q8dgf\" (UID: \"c3362698-b648-4171-960f-17efea458274\") " pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.660748 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.660660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:41.794888 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:41.794863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-q8dgf"]
Jul 23 18:10:41.796634 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:10:41.796609    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3362698_b648_4171_960f_17efea458274.slice/crio-f4ab0b53fe3e00e92140f2f3c610d0844113449fab22a036ff6d763cefa71daa WatchSource:0}: Error finding container f4ab0b53fe3e00e92140f2f3c610d0844113449fab22a036ff6d763cefa71daa: Status 404 returned error can't find the container with id f4ab0b53fe3e00e92140f2f3c610d0844113449fab22a036ff6d763cefa71daa
Jul 23 18:10:42.782799 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:42.782767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-q8dgf" event={"ID":"c3362698-b648-4171-960f-17efea458274","Type":"ContainerStarted","Data":"af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8"}
Jul 23 18:10:42.783185 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:42.782829    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:42.783185 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:42.782852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-q8dgf" event={"ID":"c3362698-b648-4171-960f-17efea458274","Type":"ContainerStarted","Data":"f4ab0b53fe3e00e92140f2f3c610d0844113449fab22a036ff6d763cefa71daa"}
Jul 23 18:10:42.808649 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:42.808603    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cf75b947b-q8dgf" podStartSLOduration=1.403662132 podStartE2EDuration="1.808588926s" totalImagesPullingTime="404.926794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:42.804860246 +0000 UTC m=+804.060337482" watchObservedRunningTime="2026-07-23 18:10:42.808588926 +0000 UTC m=+804.064066172"
Jul 23 18:10:53.792601 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:53.792569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:58.416703 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.416656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:58.528013 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.527983    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-q8dgf"]
Jul 23 18:10:58.528204 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.528164    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cf75b947b-q8dgf" podUID="c3362698-b648-4171-960f-17efea458274" containerName="manager" containerID="cri-o://af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8" gracePeriod=30
Jul 23 18:10:58.760895 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.760872    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:58.819492 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.819461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3362698-b648-4171-960f-17efea458274-webhook-cert\") pod \"c3362698-b648-4171-960f-17efea458274\" (UID: \"c3362698-b648-4171-960f-17efea458274\") "
Jul 23 18:10:58.819623 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.819540    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzrzn\" (UniqueName: \"kubernetes.io/projected/c3362698-b648-4171-960f-17efea458274-kube-api-access-pzrzn\") pod \"c3362698-b648-4171-960f-17efea458274\" (UID: \"c3362698-b648-4171-960f-17efea458274\") "
Jul 23 18:10:58.821379 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.821346    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3362698-b648-4171-960f-17efea458274-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c3362698-b648-4171-960f-17efea458274" (UID: "c3362698-b648-4171-960f-17efea458274"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:10:58.821794 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.821774    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3362698-b648-4171-960f-17efea458274-kube-api-access-pzrzn" (OuterVolumeSpecName: "kube-api-access-pzrzn") pod "c3362698-b648-4171-960f-17efea458274" (UID: "c3362698-b648-4171-960f-17efea458274"). InnerVolumeSpecName "kube-api-access-pzrzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:10:58.869248 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.869220    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3362698-b648-4171-960f-17efea458274" containerID="af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8" exitCode=0
Jul 23 18:10:58.869354 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.869257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-q8dgf" event={"ID":"c3362698-b648-4171-960f-17efea458274","Type":"ContainerDied","Data":"af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8"}
Jul 23 18:10:58.869354 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.869304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-q8dgf" event={"ID":"c3362698-b648-4171-960f-17efea458274","Type":"ContainerDied","Data":"f4ab0b53fe3e00e92140f2f3c610d0844113449fab22a036ff6d763cefa71daa"}
Jul 23 18:10:58.869354 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.869325    2560 scope.go:117] "RemoveContainer" containerID="af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8"
Jul 23 18:10:58.869354 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.869268    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-q8dgf"
Jul 23 18:10:58.878544 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.878525    2560 scope.go:117] "RemoveContainer" containerID="af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8"
Jul 23 18:10:58.878800 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:10:58.878780    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8\": container with ID starting with af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8 not found: ID does not exist" containerID="af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8"
Jul 23 18:10:58.878857 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.878809    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8"} err="failed to get container status \"af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8\": rpc error: code = NotFound desc = could not find container \"af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8\": container with ID starting with af0bb1049a8f3320e06b475927a843db9caa086bda2f7e0b8574bf3370b0d6f8 not found: ID does not exist"
Jul 23 18:10:58.897238 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.897218    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-q8dgf"]
Jul 23 18:10:58.903092 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.903070    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-q8dgf"]
Jul 23 18:10:58.920610 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.920590    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzrzn\" (UniqueName: \"kubernetes.io/projected/c3362698-b648-4171-960f-17efea458274-kube-api-access-pzrzn\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.920720 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:58.920612    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3362698-b648-4171-960f-17efea458274-webhook-cert\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:10:59.171826 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.171800    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3362698-b648-4171-960f-17efea458274" path="/var/lib/kubelet/pods/c3362698-b648-4171-960f-17efea458274/volumes"
Jul 23 18:10:59.594193 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.594159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:59.720360 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.720329    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cf75b947b-l5dkd"]
Jul 23 18:10:59.720796 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.720777    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3362698-b648-4171-960f-17efea458274" containerName="manager"
Jul 23 18:10:59.720796 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.720797    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3362698-b648-4171-960f-17efea458274" containerName="manager"
Jul 23 18:10:59.720954 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.720885    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3362698-b648-4171-960f-17efea458274" containerName="manager"
Jul 23 18:10:59.725143 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.725122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:10:59.727890 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.727868    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:10:59.728908 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.728890    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:10:59.729226 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.729205    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kwxzf\""
Jul 23 18:10:59.736641 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.736621    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-l5dkd"]
Jul 23 18:10:59.827328 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.827299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk2sk\" (UniqueName: \"kubernetes.io/projected/25908a53-2ed8-4be1-9663-37ce13aada77-kube-api-access-jk2sk\") pod \"maas-controller-6cf75b947b-l5dkd\" (UID: \"25908a53-2ed8-4be1-9663-37ce13aada77\") " pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:10:59.827483 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.827407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25908a53-2ed8-4be1-9663-37ce13aada77-webhook-cert\") pod \"maas-controller-6cf75b947b-l5dkd\" (UID: \"25908a53-2ed8-4be1-9663-37ce13aada77\") " pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:10:59.928807 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.928719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25908a53-2ed8-4be1-9663-37ce13aada77-webhook-cert\") pod \"maas-controller-6cf75b947b-l5dkd\" (UID: \"25908a53-2ed8-4be1-9663-37ce13aada77\") " pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:10:59.928807 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.928790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk2sk\" (UniqueName: \"kubernetes.io/projected/25908a53-2ed8-4be1-9663-37ce13aada77-kube-api-access-jk2sk\") pod \"maas-controller-6cf75b947b-l5dkd\" (UID: \"25908a53-2ed8-4be1-9663-37ce13aada77\") " pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:10:59.931154 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.931130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25908a53-2ed8-4be1-9663-37ce13aada77-webhook-cert\") pod \"maas-controller-6cf75b947b-l5dkd\" (UID: \"25908a53-2ed8-4be1-9663-37ce13aada77\") " pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:10:59.939867 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:10:59.939848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk2sk\" (UniqueName: \"kubernetes.io/projected/25908a53-2ed8-4be1-9663-37ce13aada77-kube-api-access-jk2sk\") pod \"maas-controller-6cf75b947b-l5dkd\" (UID: \"25908a53-2ed8-4be1-9663-37ce13aada77\") " pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:11:00.036185 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:00.036160    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:11:00.179278 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:00.179177    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf75b947b-l5dkd"]
Jul 23 18:11:00.181490 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:11:00.181462    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25908a53_2ed8_4be1_9663_37ce13aada77.slice/crio-b77e4973fdb369f01782d49df1f9112893726079755a1b8dbb5d4473f071d0ea WatchSource:0}: Error finding container b77e4973fdb369f01782d49df1f9112893726079755a1b8dbb5d4473f071d0ea: Status 404 returned error can't find the container with id b77e4973fdb369f01782d49df1f9112893726079755a1b8dbb5d4473f071d0ea
Jul 23 18:11:00.881155 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:00.881121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-l5dkd" event={"ID":"25908a53-2ed8-4be1-9663-37ce13aada77","Type":"ContainerStarted","Data":"4ad1c5cbfed09057ec3523274bb293dbe0f370eca5dc190a783d8390d3aa0ddb"}
Jul 23 18:11:00.881590 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:00.881174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf75b947b-l5dkd" event={"ID":"25908a53-2ed8-4be1-9663-37ce13aada77","Type":"ContainerStarted","Data":"b77e4973fdb369f01782d49df1f9112893726079755a1b8dbb5d4473f071d0ea"}
Jul 23 18:11:00.881590 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:00.881316    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:11:00.909553 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:00.909496    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cf75b947b-l5dkd" podStartSLOduration=1.5729200840000002 podStartE2EDuration="1.909482008s" totalImagesPullingTime="336.561924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:00.907552365 +0000 UTC m=+822.163029592" watchObservedRunningTime="2026-07-23 18:11:00.909482008 +0000 UTC m=+822.164959234"
Jul 23 18:11:11.888874 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:11.888842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cf75b947b-l5dkd"
Jul 23 18:11:30.222160 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:30.222123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:30.390739 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:30.390699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:30.506571 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:30.506497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:37.039690 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:37.039634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:37.143558 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:37.143526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:37.239403 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:37.239371    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:37.425619 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:37.425529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:38.532196 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:38.532159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:38.641794 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:38.641760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:43.869297 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:43.869262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:44.010178 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:11:44.010148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:19.181719 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:12:19.181625    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:12:19.182542 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:12:19.182524    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:12:19.210381 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:12:19.210352    2560 scope.go:117] "RemoveContainer" containerID="5ef39e5c64cb4df2c63657a58f4e298bb8b57f5f4cc18c77bdf913963cda449a"
Jul 23 18:14:27.295971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:14:27.295932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:14:39.545191 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:14:39.545152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:26.728479 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:15:26.728387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:26.829418 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:15:26.829384    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:17:19.209773 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:17:19.209747    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:17:19.211975 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:17:19.211950    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:18:06.337272 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:18:06.337241    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:19:42.861300 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:19:42.861220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:19:56.421169 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:19:56.421135    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:20:26.406020 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:20:26.405980    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:20:27.788228 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:20:27.788198    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:20:38.416380 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:20:38.416343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:20:38.512826 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:20:38.512794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:22:19.237818 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:22:19.237784    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:22:19.241187 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:22:19.241167    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:22:30.120216 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:22:30.120173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:23:38.758748 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:23:38.758708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:23:59.896203 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:23:59.896160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:03.242522 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:03.242476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:03.332594 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:03.332557    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:03.736209 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:03.736170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:09.850144 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:09.850100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:09.952877 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:09.952836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:10.108064 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:10.107978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:10.457882 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:10.457775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:10.584836 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:10.584794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:13.042167 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.042081    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:13.146333 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.146302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:13.174093 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.174066    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"]
Jul 23 18:24:13.177432 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.177413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.180032 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.180010    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e804c486-serving-cert\""
Jul 23 18:24:13.188247 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.188226    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"]
Jul 23 18:24:13.248597 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.248570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:13.314939 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.314874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf288756-c1c3-476f-a794-7f5301495b64-openshift-service-ca\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.315051 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.314941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf288756-c1c3-476f-a794-7f5301495b64-maas-api-tls\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.315051 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.314965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8krm7\" (UniqueName: \"kubernetes.io/projected/cf288756-c1c3-476f-a794-7f5301495b64-kube-api-access-8krm7\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.416279 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.416248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf288756-c1c3-476f-a794-7f5301495b64-openshift-service-ca\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.416424 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.416295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf288756-c1c3-476f-a794-7f5301495b64-maas-api-tls\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.416424 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.416319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8krm7\" (UniqueName: \"kubernetes.io/projected/cf288756-c1c3-476f-a794-7f5301495b64-kube-api-access-8krm7\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.416966 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.416946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf288756-c1c3-476f-a794-7f5301495b64-openshift-service-ca\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.418746 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.418728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf288756-c1c3-476f-a794-7f5301495b64-maas-api-tls\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.425972 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.425948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8krm7\" (UniqueName: \"kubernetes.io/projected/cf288756-c1c3-476f-a794-7f5301495b64-kube-api-access-8krm7\") pod \"maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.431348 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.431328    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:13.489148 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.489120    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:13.706766 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.706728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:13.808205 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.808175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:13.831881 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.831860    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"]
Jul 23 18:24:13.833954 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:24:13.833926    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf288756_c1c3_476f_a794_7f5301495b64.slice/crio-b40488ebf3de5ed51cf625a50cbe4fae3719919760678c8acadfe0dd5efb234e WatchSource:0}: Error finding container b40488ebf3de5ed51cf625a50cbe4fae3719919760678c8acadfe0dd5efb234e: Status 404 returned error can't find the container with id b40488ebf3de5ed51cf625a50cbe4fae3719919760678c8acadfe0dd5efb234e
Jul 23 18:24:13.835180 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:13.835158    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:24:14.578800 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:14.578712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5" event={"ID":"cf288756-c1c3-476f-a794-7f5301495b64","Type":"ContainerStarted","Data":"4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849"}
Jul 23 18:24:14.578800 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:14.578780    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5" event={"ID":"cf288756-c1c3-476f-a794-7f5301495b64","Type":"ContainerStarted","Data":"b40488ebf3de5ed51cf625a50cbe4fae3719919760678c8acadfe0dd5efb234e"}
Jul 23 18:24:14.578800 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:14.578803    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:14.601202 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:14.601157    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5" podStartSLOduration=1.131359188 podStartE2EDuration="1.601141518s" totalImagesPullingTime="469.78233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:14.599440904 +0000 UTC m=+1615.854918152" watchObservedRunningTime="2026-07-23 18:24:14.601141518 +0000 UTC m=+1615.856618789"
Jul 23 18:24:20.589460 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:20.589426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:49.319806 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.319769    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"]
Jul 23 18:24:49.322368 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.320057    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5" podUID="cf288756-c1c3-476f-a794-7f5301495b64" containerName="maas-api" containerID="cri-o://4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849" gracePeriod=30
Jul 23 18:24:49.348827 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.348799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:49.582162 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.582099    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:49.627218 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.627193    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf288756-c1c3-476f-a794-7f5301495b64-openshift-service-ca\") pod \"cf288756-c1c3-476f-a794-7f5301495b64\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") "
Jul 23 18:24:49.627385 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.627302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8krm7\" (UniqueName: \"kubernetes.io/projected/cf288756-c1c3-476f-a794-7f5301495b64-kube-api-access-8krm7\") pod \"cf288756-c1c3-476f-a794-7f5301495b64\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") "
Jul 23 18:24:49.627385 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.627360    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf288756-c1c3-476f-a794-7f5301495b64-maas-api-tls\") pod \"cf288756-c1c3-476f-a794-7f5301495b64\" (UID: \"cf288756-c1c3-476f-a794-7f5301495b64\") "
Jul 23 18:24:49.627611 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.627584    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf288756-c1c3-476f-a794-7f5301495b64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf288756-c1c3-476f-a794-7f5301495b64" (UID: "cf288756-c1c3-476f-a794-7f5301495b64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:24:49.629532 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.629499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf288756-c1c3-476f-a794-7f5301495b64-kube-api-access-8krm7" (OuterVolumeSpecName: "kube-api-access-8krm7") pod "cf288756-c1c3-476f-a794-7f5301495b64" (UID: "cf288756-c1c3-476f-a794-7f5301495b64"). InnerVolumeSpecName "kube-api-access-8krm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:24:49.629624 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.629569    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf288756-c1c3-476f-a794-7f5301495b64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf288756-c1c3-476f-a794-7f5301495b64" (UID: "cf288756-c1c3-476f-a794-7f5301495b64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:24:49.728971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.728944    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8krm7\" (UniqueName: \"kubernetes.io/projected/cf288756-c1c3-476f-a794-7f5301495b64-kube-api-access-8krm7\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:24:49.728971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.728966    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf288756-c1c3-476f-a794-7f5301495b64-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:24:49.729101 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.728976    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf288756-c1c3-476f-a794-7f5301495b64-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:24:49.743458 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.743428    2560 generic.go:356] "Generic (PLEG): container finished" podID="cf288756-c1c3-476f-a794-7f5301495b64" containerID="4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849" exitCode=0
Jul 23 18:24:49.743554 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.743472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"
Jul 23 18:24:49.743554 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.743502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5" event={"ID":"cf288756-c1c3-476f-a794-7f5301495b64","Type":"ContainerDied","Data":"4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849"}
Jul 23 18:24:49.743554 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.743552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5" event={"ID":"cf288756-c1c3-476f-a794-7f5301495b64","Type":"ContainerDied","Data":"b40488ebf3de5ed51cf625a50cbe4fae3719919760678c8acadfe0dd5efb234e"}
Jul 23 18:24:49.743661 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.743573    2560 scope.go:117] "RemoveContainer" containerID="4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849"
Jul 23 18:24:49.752298 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.752283    2560 scope.go:117] "RemoveContainer" containerID="4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849"
Jul 23 18:24:49.752526 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:24:49.752508    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849\": container with ID starting with 4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849 not found: ID does not exist" containerID="4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849"
Jul 23 18:24:49.752621 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.752533    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849"} err="failed to get container status \"4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849\": rpc error: code = NotFound desc = could not find container \"4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849\": container with ID starting with 4db87f4bdf04535b66f50b722830f119f23ac11ebe72af4d5022d30825985849 not found: ID does not exist"
Jul 23 18:24:49.764751 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.764730    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"]
Jul 23 18:24:49.768527 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:49.768507    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e804c486-5b5964b5c7-7b7g5"]
Jul 23 18:24:51.173055 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:51.173026    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf288756-c1c3-476f-a794-7f5301495b64" path="/var/lib/kubelet/pods/cf288756-c1c3-476f-a794-7f5301495b64/volumes"
Jul 23 18:24:53.928124 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:53.928088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:54.110408 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:54.110368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:54.403558 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:54.403525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:54.706276 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:54.706197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:54.804945 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:54.804910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:54.966340 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:54.966257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:55.316013 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:55.315977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:55.477210 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:55.477177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:57.446023 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.445990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:57.652981 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.652948    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"]
Jul 23 18:24:57.653377 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.653362    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf288756-c1c3-476f-a794-7f5301495b64" containerName="maas-api"
Jul 23 18:24:57.653421 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.653380    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf288756-c1c3-476f-a794-7f5301495b64" containerName="maas-api"
Jul 23 18:24:57.653474 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.653464    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf288756-c1c3-476f-a794-7f5301495b64" containerName="maas-api"
Jul 23 18:24:57.656601 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.656578    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.658994 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.658975    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-d3807a5a-serving-cert\""
Jul 23 18:24:57.666064 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.665747    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"]
Jul 23 18:24:57.689188 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.689160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:57.703667 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.703603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.703793 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.703748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88bc54b9-73fc-40db-a80c-7d511b035084-openshift-service-ca\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.703793 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.703784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99gh\" (UniqueName: \"kubernetes.io/projected/88bc54b9-73fc-40db-a80c-7d511b035084-kube-api-access-k99gh\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.809308 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.809266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88bc54b9-73fc-40db-a80c-7d511b035084-openshift-service-ca\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.809462 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.809414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99gh\" (UniqueName: \"kubernetes.io/projected/88bc54b9-73fc-40db-a80c-7d511b035084-kube-api-access-k99gh\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.809534 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.809522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.809641 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:24:57.809627    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-serving-cert: secret "maas-api-e2e-migrate-d3807a5a-serving-cert" not found
Jul 23 18:24:57.809739 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:24:57.809711    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls podName:88bc54b9-73fc-40db-a80c-7d511b035084 nodeName:}" failed. No retries permitted until 2026-07-23 18:24:58.309694396 +0000 UTC m=+1659.565171602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls") pod "maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl" (UID: "88bc54b9-73fc-40db-a80c-7d511b035084") : secret "maas-api-e2e-migrate-d3807a5a-serving-cert" not found
Jul 23 18:24:57.810009 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.809992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88bc54b9-73fc-40db-a80c-7d511b035084-openshift-service-ca\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.818153 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.818132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99gh\" (UniqueName: \"kubernetes.io/projected/88bc54b9-73fc-40db-a80c-7d511b035084-kube-api-access-k99gh\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:57.939565 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:57.939535    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:58.122371 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:58.122341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:58.223221 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:58.223190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:58.314208 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:58.314173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:58.316544 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:58.316525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls\") pod \"maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:58.570891 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:58.570853    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:58.719818 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:58.719752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"]
Jul 23 18:24:58.722102 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:24:58.722071    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bc54b9_73fc_40db_a80c_7d511b035084.slice/crio-09e99f425a351fc9ab2c10fb65e46ce0bb59d6440294d102e32a802383ceaf24 WatchSource:0}: Error finding container 09e99f425a351fc9ab2c10fb65e46ce0bb59d6440294d102e32a802383ceaf24: Status 404 returned error can't find the container with id 09e99f425a351fc9ab2c10fb65e46ce0bb59d6440294d102e32a802383ceaf24
Jul 23 18:24:58.785733 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:58.785706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl" event={"ID":"88bc54b9-73fc-40db-a80c-7d511b035084","Type":"ContainerStarted","Data":"09e99f425a351fc9ab2c10fb65e46ce0bb59d6440294d102e32a802383ceaf24"}
Jul 23 18:24:59.791292 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:59.791258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl" event={"ID":"88bc54b9-73fc-40db-a80c-7d511b035084","Type":"ContainerStarted","Data":"b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b"}
Jul 23 18:24:59.791716 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:59.791382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:24:59.810154 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:24:59.810108    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl" podStartSLOduration=2.484347854 podStartE2EDuration="2.810095159s" totalImagesPullingTime="325.747305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:59.808285217 +0000 UTC m=+1661.063762445" watchObservedRunningTime="2026-07-23 18:24:59.810095159 +0000 UTC m=+1661.065572385"
Jul 23 18:25:05.801552 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:05.801525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:25:32.953048 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:32.953017    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"]
Jul 23 18:25:32.953615 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:32.953293    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl" podUID="88bc54b9-73fc-40db-a80c-7d511b035084" containerName="maas-api" containerID="cri-o://b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b" gracePeriod=30
Jul 23 18:25:32.980648 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:32.980620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:33.204936 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.204877    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:25:33.319863 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.319826    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88bc54b9-73fc-40db-a80c-7d511b035084-openshift-service-ca\") pod \"88bc54b9-73fc-40db-a80c-7d511b035084\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") "
Jul 23 18:25:33.320038 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.319909    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k99gh\" (UniqueName: \"kubernetes.io/projected/88bc54b9-73fc-40db-a80c-7d511b035084-kube-api-access-k99gh\") pod \"88bc54b9-73fc-40db-a80c-7d511b035084\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") "
Jul 23 18:25:33.320038 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.319954    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls\") pod \"88bc54b9-73fc-40db-a80c-7d511b035084\" (UID: \"88bc54b9-73fc-40db-a80c-7d511b035084\") "
Jul 23 18:25:33.320201 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.320174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88bc54b9-73fc-40db-a80c-7d511b035084-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88bc54b9-73fc-40db-a80c-7d511b035084" (UID: "88bc54b9-73fc-40db-a80c-7d511b035084"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:25:33.322052 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.322021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88bc54b9-73fc-40db-a80c-7d511b035084" (UID: "88bc54b9-73fc-40db-a80c-7d511b035084"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:25:33.322154 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.322081    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88bc54b9-73fc-40db-a80c-7d511b035084-kube-api-access-k99gh" (OuterVolumeSpecName: "kube-api-access-k99gh") pod "88bc54b9-73fc-40db-a80c-7d511b035084" (UID: "88bc54b9-73fc-40db-a80c-7d511b035084"). InnerVolumeSpecName "kube-api-access-k99gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:25:33.420681 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.420638    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k99gh\" (UniqueName: \"kubernetes.io/projected/88bc54b9-73fc-40db-a80c-7d511b035084-kube-api-access-k99gh\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:25:33.420820 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.420697    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88bc54b9-73fc-40db-a80c-7d511b035084-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:25:33.420820 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.420708    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88bc54b9-73fc-40db-a80c-7d511b035084-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:25:33.954178 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.954143    2560 generic.go:356] "Generic (PLEG): container finished" podID="88bc54b9-73fc-40db-a80c-7d511b035084" containerID="b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b" exitCode=0
Jul 23 18:25:33.954178 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.954180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl" event={"ID":"88bc54b9-73fc-40db-a80c-7d511b035084","Type":"ContainerDied","Data":"b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b"}
Jul 23 18:25:33.954637 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.954186    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"
Jul 23 18:25:33.954637 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.954222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl" event={"ID":"88bc54b9-73fc-40db-a80c-7d511b035084","Type":"ContainerDied","Data":"09e99f425a351fc9ab2c10fb65e46ce0bb59d6440294d102e32a802383ceaf24"}
Jul 23 18:25:33.954637 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.954244    2560 scope.go:117] "RemoveContainer" containerID="b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b"
Jul 23 18:25:33.962833 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.962814    2560 scope.go:117] "RemoveContainer" containerID="b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b"
Jul 23 18:25:33.963077 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:25:33.963059    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b\": container with ID starting with b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b not found: ID does not exist" containerID="b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b"
Jul 23 18:25:33.963149 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.963085    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b"} err="failed to get container status \"b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b\": rpc error: code = NotFound desc = could not find container \"b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b\": container with ID starting with b246b0c7b0e21e52b9e8664316bf9a694a76dfa23b3935befe30dd125674d92b not found: ID does not exist"
Jul 23 18:25:33.975157 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.975131    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"]
Jul 23 18:25:33.978947 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:33.978928    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d3807a5a-5485fd99f9-598pl"]
Jul 23 18:25:35.172540 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:35.172507    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88bc54b9-73fc-40db-a80c-7d511b035084" path="/var/lib/kubelet/pods/88bc54b9-73fc-40db-a80c-7d511b035084/volumes"
Jul 23 18:25:37.608504 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:37.608469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:37.775192 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:37.775154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:38.023198 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:38.023086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:38.260085 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:38.260052    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:38.607085 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:38.607040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:38.908073 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:38.907972    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:41.567133 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.567048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:41.663961 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.663927    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:41.781995 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.781966    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"]
Jul 23 18:25:41.782342 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.782331    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bc54b9-73fc-40db-a80c-7d511b035084" containerName="maas-api"
Jul 23 18:25:41.782398 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.782344    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bc54b9-73fc-40db-a80c-7d511b035084" containerName="maas-api"
Jul 23 18:25:41.782439 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.782430    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88bc54b9-73fc-40db-a80c-7d511b035084" containerName="maas-api"
Jul 23 18:25:41.786660 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.786641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.789041 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.789018    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5369f610-serving-cert\""
Jul 23 18:25:41.795834 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.795813    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"]
Jul 23 18:25:41.809044 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.809022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:41.887395 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.887330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-maas-api-tls\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.887515 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.887465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nls6q\" (UniqueName: \"kubernetes.io/projected/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-kube-api-access-nls6q\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.887515 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.887503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-openshift-service-ca\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.987943 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.987912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nls6q\" (UniqueName: \"kubernetes.io/projected/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-kube-api-access-nls6q\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.987943 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.987944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-openshift-service-ca\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.988158 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.987990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-maas-api-tls\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.988751 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.988720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-openshift-service-ca\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.990469 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.990448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-maas-api-tls\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:41.996943 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:41.996921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nls6q\" (UniqueName: \"kubernetes.io/projected/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-kube-api-access-nls6q\") pod \"maas-api-e2e-ait-5369f610-7467c7df57-28j77\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:42.010134 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:42.010103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:42.097854 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:42.097830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:42.318327 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:42.318284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:42.419656 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:42.419562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:42.440271 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:42.440252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"]
Jul 23 18:25:42.442487 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:25:42.442461    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7ff9fc_bab3_43e7_948d_1ff038b50c15.slice/crio-f83afb303582e33a37c3155ed284733c14e1b5132909a0b1105f96156ff3b6b3 WatchSource:0}: Error finding container f83afb303582e33a37c3155ed284733c14e1b5132909a0b1105f96156ff3b6b3: Status 404 returned error can't find the container with id f83afb303582e33a37c3155ed284733c14e1b5132909a0b1105f96156ff3b6b3
Jul 23 18:25:42.997711 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:42.997660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77" event={"ID":"ed7ff9fc-bab3-43e7-948d-1ff038b50c15","Type":"ContainerStarted","Data":"f83afb303582e33a37c3155ed284733c14e1b5132909a0b1105f96156ff3b6b3"}
Jul 23 18:25:44.003406 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:44.003369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77" event={"ID":"ed7ff9fc-bab3-43e7-948d-1ff038b50c15","Type":"ContainerStarted","Data":"5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3"}
Jul 23 18:25:44.003845 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:44.003560    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:25:44.021967 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:44.021919    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77" podStartSLOduration=2.151384955 podStartE2EDuration="3.021906094s" totalImagesPullingTime="870.521139ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:25:44.019645095 +0000 UTC m=+1705.275122323" watchObservedRunningTime="2026-07-23 18:25:44.021906094 +0000 UTC m=+1705.277383320"
Jul 23 18:25:50.013958 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:25:50.013928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:26:17.881653 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:17.881609    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"]
Jul 23 18:26:17.882260 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:17.881903    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77" podUID="ed7ff9fc-bab3-43e7-948d-1ff038b50c15" containerName="maas-api" containerID="cri-o://5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3" gracePeriod=30
Jul 23 18:26:17.914489 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:17.914455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:18.134065 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.134002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:26:18.171142 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.171113    2560 generic.go:356] "Generic (PLEG): container finished" podID="ed7ff9fc-bab3-43e7-948d-1ff038b50c15" containerID="5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3" exitCode=0
Jul 23 18:26:18.171315 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.171155    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"
Jul 23 18:26:18.171315 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.171151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77" event={"ID":"ed7ff9fc-bab3-43e7-948d-1ff038b50c15","Type":"ContainerDied","Data":"5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3"}
Jul 23 18:26:18.171315 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.171257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77" event={"ID":"ed7ff9fc-bab3-43e7-948d-1ff038b50c15","Type":"ContainerDied","Data":"f83afb303582e33a37c3155ed284733c14e1b5132909a0b1105f96156ff3b6b3"}
Jul 23 18:26:18.171315 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.171275    2560 scope.go:117] "RemoveContainer" containerID="5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3"
Jul 23 18:26:18.179715 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.179698    2560 scope.go:117] "RemoveContainer" containerID="5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3"
Jul 23 18:26:18.179951 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:26:18.179932    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3\": container with ID starting with 5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3 not found: ID does not exist" containerID="5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3"
Jul 23 18:26:18.180029 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.179962    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3"} err="failed to get container status \"5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3\": rpc error: code = NotFound desc = could not find container \"5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3\": container with ID starting with 5b8dc56b434d44fe1e90dcdcb9e2502811378684a4c3202416609e562fddc5f3 not found: ID does not exist"
Jul 23 18:26:18.209526 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.209500    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-maas-api-tls\") pod \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") "
Jul 23 18:26:18.209627 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.209562    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-openshift-service-ca\") pod \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") "
Jul 23 18:26:18.209627 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.209592    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nls6q\" (UniqueName: \"kubernetes.io/projected/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-kube-api-access-nls6q\") pod \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\" (UID: \"ed7ff9fc-bab3-43e7-948d-1ff038b50c15\") "
Jul 23 18:26:18.209946 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.209912    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed7ff9fc-bab3-43e7-948d-1ff038b50c15" (UID: "ed7ff9fc-bab3-43e7-948d-1ff038b50c15"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:26:18.211559 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.211530    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-kube-api-access-nls6q" (OuterVolumeSpecName: "kube-api-access-nls6q") pod "ed7ff9fc-bab3-43e7-948d-1ff038b50c15" (UID: "ed7ff9fc-bab3-43e7-948d-1ff038b50c15"). InnerVolumeSpecName "kube-api-access-nls6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:26:18.211622 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.211560    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed7ff9fc-bab3-43e7-948d-1ff038b50c15" (UID: "ed7ff9fc-bab3-43e7-948d-1ff038b50c15"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:26:18.311209 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.311172    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:26:18.311209 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.311201    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nls6q\" (UniqueName: \"kubernetes.io/projected/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-kube-api-access-nls6q\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:26:18.311209 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.311212    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7ff9fc-bab3-43e7-948d-1ff038b50c15-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:26:18.493977 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.493944    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"]
Jul 23 18:26:18.500265 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:18.500242    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5369f610-7467c7df57-28j77"]
Jul 23 18:26:19.173062 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:19.173034    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed7ff9fc-bab3-43e7-948d-1ff038b50c15" path="/var/lib/kubelet/pods/ed7ff9fc-bab3-43e7-948d-1ff038b50c15/volumes"
Jul 23 18:26:20.953238 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:20.953202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:21.057280 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:21.057235    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:22.590258 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:22.590207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:23.863061 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:23.863023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:24.097075 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:24.097039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:24.341039 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:24.341002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:24.683420 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:24.683313    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:24.779936 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:24.779900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:26.805299 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.805254    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:26.895239 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.895205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:26.896233 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.896213    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"]
Jul 23 18:26:26.896707 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.896690    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed7ff9fc-bab3-43e7-948d-1ff038b50c15" containerName="maas-api"
Jul 23 18:26:26.896758 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.896709    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed7ff9fc-bab3-43e7-948d-1ff038b50c15" containerName="maas-api"
Jul 23 18:26:26.896795 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.896778    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed7ff9fc-bab3-43e7-948d-1ff038b50c15" containerName="maas-api"
Jul 23 18:26:26.899979 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.899958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:26.905686 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.905657    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-dbbc2941-serving-cert\""
Jul 23 18:26:26.919377 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.919337    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"]
Jul 23 18:26:26.994124 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.994093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13b0080f-a263-4ae6-bab5-af982a0a0602-maas-api-tls\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:26.994288 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.994193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpfjx\" (UniqueName: \"kubernetes.io/projected/13b0080f-a263-4ae6-bab5-af982a0a0602-kube-api-access-xpfjx\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:26.994288 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:26.994218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13b0080f-a263-4ae6-bab5-af982a0a0602-openshift-service-ca\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.068138 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.068048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:27.095238 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.095194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13b0080f-a263-4ae6-bab5-af982a0a0602-maas-api-tls\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.095422 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.095337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpfjx\" (UniqueName: \"kubernetes.io/projected/13b0080f-a263-4ae6-bab5-af982a0a0602-kube-api-access-xpfjx\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.095422 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.095383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13b0080f-a263-4ae6-bab5-af982a0a0602-openshift-service-ca\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.096202 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.096174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13b0080f-a263-4ae6-bab5-af982a0a0602-openshift-service-ca\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.097621 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.097597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13b0080f-a263-4ae6-bab5-af982a0a0602-maas-api-tls\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.107728 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.107660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpfjx\" (UniqueName: \"kubernetes.io/projected/13b0080f-a263-4ae6-bab5-af982a0a0602-kube-api-access-xpfjx\") pod \"maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.195190 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.195153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:27.210175 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.210136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:27.343066 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.343040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"]
Jul 23 18:26:27.345238 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:26:27.345210    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b0080f_a263_4ae6_bab5_af982a0a0602.slice/crio-b8c1f947d5d58106c59b06b9239d71eed241e0a540b55b88c58714e282751499 WatchSource:0}: Error finding container b8c1f947d5d58106c59b06b9239d71eed241e0a540b55b88c58714e282751499: Status 404 returned error can't find the container with id b8c1f947d5d58106c59b06b9239d71eed241e0a540b55b88c58714e282751499
Jul 23 18:26:27.576824 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.576790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:27.678248 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:27.678171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:28.220164 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:28.220128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5" event={"ID":"13b0080f-a263-4ae6-bab5-af982a0a0602","Type":"ContainerStarted","Data":"a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619"}
Jul 23 18:26:28.220641 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:28.220182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5" event={"ID":"13b0080f-a263-4ae6-bab5-af982a0a0602","Type":"ContainerStarted","Data":"b8c1f947d5d58106c59b06b9239d71eed241e0a540b55b88c58714e282751499"}
Jul 23 18:26:28.220641 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:28.220252    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:26:28.238860 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:28.238809    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5" podStartSLOduration=1.782712675 podStartE2EDuration="2.238789558s" totalImagesPullingTime="456.076883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:28.238544515 +0000 UTC m=+1749.494021741" watchObservedRunningTime="2026-07-23 18:26:28.238789558 +0000 UTC m=+1749.494266784"
Jul 23 18:26:34.230253 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:26:34.230226    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:27:02.299047 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.299009    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"]
Jul 23 18:27:02.299508 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.299194    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5" podUID="13b0080f-a263-4ae6-bab5-af982a0a0602" containerName="maas-api" containerID="cri-o://a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619" gracePeriod=30
Jul 23 18:27:02.324542 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.324509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:02.551555 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.551499    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:27:02.619188 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.619163    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13b0080f-a263-4ae6-bab5-af982a0a0602-openshift-service-ca\") pod \"13b0080f-a263-4ae6-bab5-af982a0a0602\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") "
Jul 23 18:27:02.619338 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.619205    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13b0080f-a263-4ae6-bab5-af982a0a0602-maas-api-tls\") pod \"13b0080f-a263-4ae6-bab5-af982a0a0602\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") "
Jul 23 18:27:02.619338 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.619306    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpfjx\" (UniqueName: \"kubernetes.io/projected/13b0080f-a263-4ae6-bab5-af982a0a0602-kube-api-access-xpfjx\") pod \"13b0080f-a263-4ae6-bab5-af982a0a0602\" (UID: \"13b0080f-a263-4ae6-bab5-af982a0a0602\") "
Jul 23 18:27:02.619531 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.619505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b0080f-a263-4ae6-bab5-af982a0a0602-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13b0080f-a263-4ae6-bab5-af982a0a0602" (UID: "13b0080f-a263-4ae6-bab5-af982a0a0602"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:27:02.621285 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.621258    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b0080f-a263-4ae6-bab5-af982a0a0602-kube-api-access-xpfjx" (OuterVolumeSpecName: "kube-api-access-xpfjx") pod "13b0080f-a263-4ae6-bab5-af982a0a0602" (UID: "13b0080f-a263-4ae6-bab5-af982a0a0602"). InnerVolumeSpecName "kube-api-access-xpfjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:27:02.621285 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.621268    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13b0080f-a263-4ae6-bab5-af982a0a0602-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13b0080f-a263-4ae6-bab5-af982a0a0602" (UID: "13b0080f-a263-4ae6-bab5-af982a0a0602"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:27:02.720922 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.720885    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpfjx\" (UniqueName: \"kubernetes.io/projected/13b0080f-a263-4ae6-bab5-af982a0a0602-kube-api-access-xpfjx\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:27:02.720922 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.720914    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13b0080f-a263-4ae6-bab5-af982a0a0602-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:27:02.720922 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:02.720924    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13b0080f-a263-4ae6-bab5-af982a0a0602-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:27:03.390571 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.390536    2560 generic.go:356] "Generic (PLEG): container finished" podID="13b0080f-a263-4ae6-bab5-af982a0a0602" containerID="a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619" exitCode=0
Jul 23 18:27:03.390571 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.390576    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"
Jul 23 18:27:03.391085 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.390620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5" event={"ID":"13b0080f-a263-4ae6-bab5-af982a0a0602","Type":"ContainerDied","Data":"a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619"}
Jul 23 18:27:03.391085 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.390686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5" event={"ID":"13b0080f-a263-4ae6-bab5-af982a0a0602","Type":"ContainerDied","Data":"b8c1f947d5d58106c59b06b9239d71eed241e0a540b55b88c58714e282751499"}
Jul 23 18:27:03.391085 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.390717    2560 scope.go:117] "RemoveContainer" containerID="a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619"
Jul 23 18:27:03.405489 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.405462    2560 scope.go:117] "RemoveContainer" containerID="a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619"
Jul 23 18:27:03.405913 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:27:03.405887    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619\": container with ID starting with a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619 not found: ID does not exist" containerID="a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619"
Jul 23 18:27:03.405975 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.405930    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619"} err="failed to get container status \"a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619\": rpc error: code = NotFound desc = could not find container \"a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619\": container with ID starting with a35df4a996786974e7a83ee630156dcded82b25724f058bfdd10129b281b6619 not found: ID does not exist"
Jul 23 18:27:03.411748 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.411725    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"]
Jul 23 18:27:03.416005 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:03.415984    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dbbc2941-69f876b545-5r9x5"]
Jul 23 18:27:05.172506 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:05.172471    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13b0080f-a263-4ae6-bab5-af982a0a0602" path="/var/lib/kubelet/pods/13b0080f-a263-4ae6-bab5-af982a0a0602/volumes"
Jul 23 18:27:06.791217 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:06.791173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:06.953982 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:06.953937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:07.194935 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:07.194851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:07.711959 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:07.711925    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:07.857996 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:07.857963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:07.955976 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:07.955938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:09.381234 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:09.381202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:15.914522 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:15.914432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:16.025363 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:16.025330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:16.182512 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:16.182434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:16.310760 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:16.310724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:16.719943 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:16.719908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:19.266081 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:19.266054    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:27:19.271464 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:19.271443    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:27:42.739339 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:42.739306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:49.115095 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:49.115057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:49.221241 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:49.221204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:49.316039 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:27:49.316001    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:05.305929 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:05.305885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:11.323641 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:11.323597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:11.438092 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:11.438053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:11.542020 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:11.541983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:22.129270 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:22.129227    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:22.956257 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:22.956221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:31.004138 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:31.004100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:31.263332 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:31.263246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:31.454558 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:31.454520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:32.397116 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:32.397079    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:32.602585 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:32.602544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:34.507795 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:34.507756    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:42.252385 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:42.252266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:42.352450 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:42.352419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:42.963389 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:42.963356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:50.445113 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:50.445074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:50.542945 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:50.542910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:50.746663 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:50.746583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:51.136286 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:51.136255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:51.517952 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:51.517864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:54.307778 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.307736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:54.406098 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.406068    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"]
Jul 23 18:28:54.406467 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.406455    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b0080f-a263-4ae6-bab5-af982a0a0602" containerName="maas-api"
Jul 23 18:28:54.406510 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.406469    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b0080f-a263-4ae6-bab5-af982a0a0602" containerName="maas-api"
Jul 23 18:28:54.406549 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.406536    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="13b0080f-a263-4ae6-bab5-af982a0a0602" containerName="maas-api"
Jul 23 18:28:54.409311 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.409283    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:54.409610 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.409594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.414270 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.414249    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-35934046-serving-cert\""
Jul 23 18:28:54.427060 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.427039    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"]
Jul 23 18:28:54.530864 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.530828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:54.533966 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.533939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e09699-0363-4181-9412-b484cfcab061-maas-api-tls\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.534112 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.534040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09699-0363-4181-9412-b484cfcab061-openshift-service-ca\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.534112 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.534074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stl7c\" (UniqueName: \"kubernetes.io/projected/80e09699-0363-4181-9412-b484cfcab061-kube-api-access-stl7c\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.613594 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.613516    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:54.635047 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.635023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09699-0363-4181-9412-b484cfcab061-openshift-service-ca\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.635169 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.635052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stl7c\" (UniqueName: \"kubernetes.io/projected/80e09699-0363-4181-9412-b484cfcab061-kube-api-access-stl7c\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.635169 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.635136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e09699-0363-4181-9412-b484cfcab061-maas-api-tls\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.635761 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.635744    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09699-0363-4181-9412-b484cfcab061-openshift-service-ca\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.637430 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.637411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e09699-0363-4181-9412-b484cfcab061-maas-api-tls\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.649877 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.649857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stl7c\" (UniqueName: \"kubernetes.io/projected/80e09699-0363-4181-9412-b484cfcab061-kube-api-access-stl7c\") pod \"maas-api-e2e-mt-35934046-97c6d7774-2wrn6\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.720753 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.720733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:54.856852 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.856818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"]
Jul 23 18:28:54.858646 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:28:54.858614    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e09699_0363_4181_9412_b484cfcab061.slice/crio-56925fd5a21dd004f652de1fb07971a1c5ba9cfed75374d9ecc5949e097e9695 WatchSource:0}: Error finding container 56925fd5a21dd004f652de1fb07971a1c5ba9cfed75374d9ecc5949e097e9695: Status 404 returned error can't find the container with id 56925fd5a21dd004f652de1fb07971a1c5ba9cfed75374d9ecc5949e097e9695
Jul 23 18:28:54.928403 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:54.928342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6" event={"ID":"80e09699-0363-4181-9412-b484cfcab061","Type":"ContainerStarted","Data":"56925fd5a21dd004f652de1fb07971a1c5ba9cfed75374d9ecc5949e097e9695"}
Jul 23 18:28:55.044421 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:55.044380    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:55.141210 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:55.141179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:55.934619 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:55.934537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6" event={"ID":"80e09699-0363-4181-9412-b484cfcab061","Type":"ContainerStarted","Data":"3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15"}
Jul 23 18:28:55.935000 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:55.934652    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:28:55.954295 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:55.954251    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6" podStartSLOduration=1.272503712 podStartE2EDuration="1.954235422s" totalImagesPullingTime="681.73171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:28:55.952591891 +0000 UTC m=+1897.208069116" watchObservedRunningTime="2026-07-23 18:28:55.954235422 +0000 UTC m=+1897.209712647"
Jul 23 18:28:58.866284 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:58.866249    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:59.542822 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:59.542785    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:28:59.645791 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:28:59.645744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:00.011397 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:00.011295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:01.944472 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:01.944445    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:29:06.482171 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:06.482136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:06.553332 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:06.553287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:17.479618 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.479582    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"]
Jul 23 18:29:17.480090 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.479872    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6" podUID="80e09699-0363-4181-9412-b484cfcab061" containerName="maas-api" containerID="cri-o://3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15" gracePeriod=30
Jul 23 18:29:17.504648 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.504619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:17.734484 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.734430    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:29:17.831503 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.831475    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e09699-0363-4181-9412-b484cfcab061-maas-api-tls\") pod \"80e09699-0363-4181-9412-b484cfcab061\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") "
Jul 23 18:29:17.831624 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.831510    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09699-0363-4181-9412-b484cfcab061-openshift-service-ca\") pod \"80e09699-0363-4181-9412-b484cfcab061\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") "
Jul 23 18:29:17.831624 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.831527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stl7c\" (UniqueName: \"kubernetes.io/projected/80e09699-0363-4181-9412-b484cfcab061-kube-api-access-stl7c\") pod \"80e09699-0363-4181-9412-b484cfcab061\" (UID: \"80e09699-0363-4181-9412-b484cfcab061\") "
Jul 23 18:29:17.831941 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.831893    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e09699-0363-4181-9412-b484cfcab061-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80e09699-0363-4181-9412-b484cfcab061" (UID: "80e09699-0363-4181-9412-b484cfcab061"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:29:17.833458 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.833429    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e09699-0363-4181-9412-b484cfcab061-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80e09699-0363-4181-9412-b484cfcab061" (UID: "80e09699-0363-4181-9412-b484cfcab061"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:29:17.833555 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.833537    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e09699-0363-4181-9412-b484cfcab061-kube-api-access-stl7c" (OuterVolumeSpecName: "kube-api-access-stl7c") pod "80e09699-0363-4181-9412-b484cfcab061" (UID: "80e09699-0363-4181-9412-b484cfcab061"). InnerVolumeSpecName "kube-api-access-stl7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:29:17.932383 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.932364    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e09699-0363-4181-9412-b484cfcab061-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:29:17.932383 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.932384    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09699-0363-4181-9412-b484cfcab061-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:29:17.932521 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:17.932397    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stl7c\" (UniqueName: \"kubernetes.io/projected/80e09699-0363-4181-9412-b484cfcab061-kube-api-access-stl7c\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:29:18.035535 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.035503    2560 generic.go:356] "Generic (PLEG): container finished" podID="80e09699-0363-4181-9412-b484cfcab061" containerID="3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15" exitCode=0
Jul 23 18:29:18.035725 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.035546    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"
Jul 23 18:29:18.035725 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.035596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6" event={"ID":"80e09699-0363-4181-9412-b484cfcab061","Type":"ContainerDied","Data":"3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15"}
Jul 23 18:29:18.035725 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.035657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6" event={"ID":"80e09699-0363-4181-9412-b484cfcab061","Type":"ContainerDied","Data":"56925fd5a21dd004f652de1fb07971a1c5ba9cfed75374d9ecc5949e097e9695"}
Jul 23 18:29:18.035725 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.035714    2560 scope.go:117] "RemoveContainer" containerID="3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15"
Jul 23 18:29:18.045039 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.045024    2560 scope.go:117] "RemoveContainer" containerID="3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15"
Jul 23 18:29:18.045281 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:29:18.045264    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15\": container with ID starting with 3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15 not found: ID does not exist" containerID="3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15"
Jul 23 18:29:18.045322 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.045290    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15"} err="failed to get container status \"3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15\": rpc error: code = NotFound desc = could not find container \"3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15\": container with ID starting with 3bd7871eacbba004a1ba1a49a9625a7e54f052248d3f6aad2afea8e476c13e15 not found: ID does not exist"
Jul 23 18:29:18.059206 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.059177    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"]
Jul 23 18:29:18.066058 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:18.066040    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35934046-97c6d7774-2wrn6"]
Jul 23 18:29:19.173035 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:19.173003    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e09699-0363-4181-9412-b484cfcab061" path="/var/lib/kubelet/pods/80e09699-0363-4181-9412-b484cfcab061/volumes"
Jul 23 18:29:21.998141 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:21.998106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:22.417129 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:22.417092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:24.238798 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:24.238756    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:24.338828 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:24.338796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:28.480040 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:28.480002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:28.560259 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:28.560220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:28.752657 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:28.752572    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:28.989558 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:28.989509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:29.161778 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:29.161747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:29.256430 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:29.256388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:29.439951 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:29.439855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:35.404372 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:35.404329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:35.513483 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:35.513451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:35.618729 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:35.618697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:35.788971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:35.788938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:41.631033 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:41.630995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:41.765368 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:41.765337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:48.633909 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:48.633872    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:49.023196 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:49.023108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:49.123962 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:49.123925    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:51.591484 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.591444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:51.663879 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.663849    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"]
Jul 23 18:29:51.664259 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.664244    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e09699-0363-4181-9412-b484cfcab061" containerName="maas-api"
Jul 23 18:29:51.664259 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.664258    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e09699-0363-4181-9412-b484cfcab061" containerName="maas-api"
Jul 23 18:29:51.664425 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.664336    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e09699-0363-4181-9412-b484cfcab061" containerName="maas-api"
Jul 23 18:29:51.667188 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.667163    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.669658 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.669639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ec1a268e-serving-cert\""
Jul 23 18:29:51.677480 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.677458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"]
Jul 23 18:29:51.736127 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.736102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c23444-ab19-453e-bd99-b9926ed7e851-openshift-service-ca\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.736249 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.736135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c23444-ab19-453e-bd99-b9926ed7e851-maas-api-tls\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.736249 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.736224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg67c\" (UniqueName: \"kubernetes.io/projected/06c23444-ab19-453e-bd99-b9926ed7e851-kube-api-access-qg67c\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.837746 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.837708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg67c\" (UniqueName: \"kubernetes.io/projected/06c23444-ab19-453e-bd99-b9926ed7e851-kube-api-access-qg67c\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.837930 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.837788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c23444-ab19-453e-bd99-b9926ed7e851-openshift-service-ca\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.837930 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.837823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c23444-ab19-453e-bd99-b9926ed7e851-maas-api-tls\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.838448 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.838426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c23444-ab19-453e-bd99-b9926ed7e851-openshift-service-ca\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.840464 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.840440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c23444-ab19-453e-bd99-b9926ed7e851-maas-api-tls\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.847822 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.847773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg67c\" (UniqueName: \"kubernetes.io/projected/06c23444-ab19-453e-bd99-b9926ed7e851-kube-api-access-qg67c\") pod \"maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:51.979117 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:51.979088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:52.113294 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:52.113270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"]
Jul 23 18:29:52.115571 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:29:52.115547    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c23444_ab19_453e_bd99_b9926ed7e851.slice/crio-faf3614edc2b3885d830657bedf1c79d425a4b4769c1f19e54243158d1fb57f5 WatchSource:0}: Error finding container faf3614edc2b3885d830657bedf1c79d425a4b4769c1f19e54243158d1fb57f5: Status 404 returned error can't find the container with id faf3614edc2b3885d830657bedf1c79d425a4b4769c1f19e54243158d1fb57f5
Jul 23 18:29:52.116980 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:52.116963    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:29:52.196730 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:52.196701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn" event={"ID":"06c23444-ab19-453e-bd99-b9926ed7e851","Type":"ContainerStarted","Data":"faf3614edc2b3885d830657bedf1c79d425a4b4769c1f19e54243158d1fb57f5"}
Jul 23 18:29:52.884343 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:52.884313    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:53.203045 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:53.202960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn" event={"ID":"06c23444-ab19-453e-bd99-b9926ed7e851","Type":"ContainerStarted","Data":"164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e"}
Jul 23 18:29:53.203212 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:53.203085    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:29:53.233065 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:53.233017    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn" podStartSLOduration=1.864623098 podStartE2EDuration="2.232995224s" totalImagesPullingTime="368.372126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:29:53.232445838 +0000 UTC m=+1954.487923066" watchObservedRunningTime="2026-07-23 18:29:53.232995224 +0000 UTC m=+1954.488472450"
Jul 23 18:29:56.106198 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:56.106164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:59.213398 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:29:59.213373    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:30:09.021737 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:09.021697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:45.192306 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.192229    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"]
Jul 23 18:30:45.192912 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.192434    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn" podUID="06c23444-ab19-453e-bd99-b9926ed7e851" containerName="maas-api" containerID="cri-o://164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e" gracePeriod=30
Jul 23 18:30:45.222548 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.222515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:45.445957 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.445902    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:30:45.451767 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.451737    2560 generic.go:356] "Generic (PLEG): container finished" podID="06c23444-ab19-453e-bd99-b9926ed7e851" containerID="164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e" exitCode=0
Jul 23 18:30:45.451881 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.451777    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"
Jul 23 18:30:45.451881 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.451812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn" event={"ID":"06c23444-ab19-453e-bd99-b9926ed7e851","Type":"ContainerDied","Data":"164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e"}
Jul 23 18:30:45.451881 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.451861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn" event={"ID":"06c23444-ab19-453e-bd99-b9926ed7e851","Type":"ContainerDied","Data":"faf3614edc2b3885d830657bedf1c79d425a4b4769c1f19e54243158d1fb57f5"}
Jul 23 18:30:45.452011 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.451883    2560 scope.go:117] "RemoveContainer" containerID="164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e"
Jul 23 18:30:45.461913 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.461894    2560 scope.go:117] "RemoveContainer" containerID="164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e"
Jul 23 18:30:45.462168 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:30:45.462151    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e\": container with ID starting with 164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e not found: ID does not exist" containerID="164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e"
Jul 23 18:30:45.462232 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.462176    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e"} err="failed to get container status \"164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e\": rpc error: code = NotFound desc = could not find container \"164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e\": container with ID starting with 164009997f181c9bf864554f6d731eff2678ebe9b61057a1b49589cafe9a9f1e not found: ID does not exist"
Jul 23 18:30:45.537834 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.537804    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg67c\" (UniqueName: \"kubernetes.io/projected/06c23444-ab19-453e-bd99-b9926ed7e851-kube-api-access-qg67c\") pod \"06c23444-ab19-453e-bd99-b9926ed7e851\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") "
Jul 23 18:30:45.537997 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.537842    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c23444-ab19-453e-bd99-b9926ed7e851-maas-api-tls\") pod \"06c23444-ab19-453e-bd99-b9926ed7e851\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") "
Jul 23 18:30:45.537997 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.537898    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c23444-ab19-453e-bd99-b9926ed7e851-openshift-service-ca\") pod \"06c23444-ab19-453e-bd99-b9926ed7e851\" (UID: \"06c23444-ab19-453e-bd99-b9926ed7e851\") "
Jul 23 18:30:45.538363 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.538335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c23444-ab19-453e-bd99-b9926ed7e851-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06c23444-ab19-453e-bd99-b9926ed7e851" (UID: "06c23444-ab19-453e-bd99-b9926ed7e851"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:30:45.539944 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.539912    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c23444-ab19-453e-bd99-b9926ed7e851-kube-api-access-qg67c" (OuterVolumeSpecName: "kube-api-access-qg67c") pod "06c23444-ab19-453e-bd99-b9926ed7e851" (UID: "06c23444-ab19-453e-bd99-b9926ed7e851"). InnerVolumeSpecName "kube-api-access-qg67c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:30:45.540040 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.540019    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06c23444-ab19-453e-bd99-b9926ed7e851-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06c23444-ab19-453e-bd99-b9926ed7e851" (UID: "06c23444-ab19-453e-bd99-b9926ed7e851"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:30:45.639325 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.639283    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg67c\" (UniqueName: \"kubernetes.io/projected/06c23444-ab19-453e-bd99-b9926ed7e851-kube-api-access-qg67c\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:30:45.639325 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.639321    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c23444-ab19-453e-bd99-b9926ed7e851-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:30:45.639325 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.639330    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c23444-ab19-453e-bd99-b9926ed7e851-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:30:45.775235 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.775205    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"]
Jul 23 18:30:45.776197 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:45.776179    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ec1a268e-69d4b9449-x9gqn"]
Jul 23 18:30:47.172505 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:47.172474    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c23444-ab19-453e-bd99-b9926ed7e851" path="/var/lib/kubelet/pods/06c23444-ab19-453e-bd99-b9926ed7e851/volumes"
Jul 23 18:30:49.782720 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:49.782650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:52.158449 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:52.158399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:57.190546 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:30:57.190514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:21.900164 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:21.900126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:22.069126 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:22.069087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:32.916154 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:32.916116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:33.450599 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:33.450565    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:35.255364 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:35.255331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:39.911689 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:39.911639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:40.956938 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:40.956902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:55.446024 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:55.445936    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:55.544949 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:55.544919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:55.745647 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:55.745564    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:56.003217 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:56.003138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:57.176578 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:57.176542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:57.269906 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:57.269868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:57.367113 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:57.367064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:58.185451 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:58.185417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:58.348597 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:58.348562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:58.493055 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:58.492975    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:59.877570 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:31:59.877532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:05.806697 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:05.806643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:05.906605 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:05.906566    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:06.502912 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:06.502871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:13.411121 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:13.411077    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:13.517739 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:13.517698    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:13.614886 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:13.614844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:19.295539 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:19.295509    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:32:19.302549 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:19.302523    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:32:24.171967 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:24.171930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:24.545354 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:24.545318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:45.579092 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:45.579054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:52.524217 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:52.524178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:52.610146 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:52.610110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:52.886407 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:52.886367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:53.217532 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:53.217432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:53.451841 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:53.451797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:54.592791 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:54.592752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:56.657644 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.657597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:56.755013 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.754984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:56.898901 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.898870    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"]
Jul 23 18:32:56.899349 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.899332    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c23444-ab19-453e-bd99-b9926ed7e851" containerName="maas-api"
Jul 23 18:32:56.899405 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.899350    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c23444-ab19-453e-bd99-b9926ed7e851" containerName="maas-api"
Jul 23 18:32:56.899447 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.899416    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c23444-ab19-453e-bd99-b9926ed7e851" containerName="maas-api"
Jul 23 18:32:56.902460 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.902442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:56.905362 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.905339    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-954ecd-serving-cert\""
Jul 23 18:32:56.916814 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.916792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"]
Jul 23 18:32:56.944590 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:56.944551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:57.005588 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.005548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5122e4a-7280-4983-88e1-5f559a0566dc-maas-api-tls\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.005785 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.005752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5km\" (UniqueName: \"kubernetes.io/projected/b5122e4a-7280-4983-88e1-5f559a0566dc-kube-api-access-mw5km\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.005886 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.005863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5122e4a-7280-4983-88e1-5f559a0566dc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.052111 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.052076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:57.106852 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.106818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5122e4a-7280-4983-88e1-5f559a0566dc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.107005 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.106915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5122e4a-7280-4983-88e1-5f559a0566dc-maas-api-tls\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.107005 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.106947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5km\" (UniqueName: \"kubernetes.io/projected/b5122e4a-7280-4983-88e1-5f559a0566dc-kube-api-access-mw5km\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.107547 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.107527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5122e4a-7280-4983-88e1-5f559a0566dc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.109360 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.109337    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5122e4a-7280-4983-88e1-5f559a0566dc-maas-api-tls\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.116090 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.116048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5km\" (UniqueName: \"kubernetes.io/projected/b5122e4a-7280-4983-88e1-5f559a0566dc-kube-api-access-mw5km\") pod \"maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.212760 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.212678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:57.449012 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.448973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:57.556107 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.556078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:57.562607 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:57.562588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"]
Jul 23 18:32:57.564472 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:32:57.564433    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5122e4a_7280_4983_88e1_5f559a0566dc.slice/crio-d05e9a9240d58a8e8e61866cbcf70300e6da40bcc5504742618e52f8f768ff23 WatchSource:0}: Error finding container d05e9a9240d58a8e8e61866cbcf70300e6da40bcc5504742618e52f8f768ff23: Status 404 returned error can't find the container with id d05e9a9240d58a8e8e61866cbcf70300e6da40bcc5504742618e52f8f768ff23
Jul 23 18:32:58.084635 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:58.084589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7" event={"ID":"b5122e4a-7280-4983-88e1-5f559a0566dc","Type":"ContainerStarted","Data":"861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a"}
Jul 23 18:32:58.085063 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:58.084661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7" event={"ID":"b5122e4a-7280-4983-88e1-5f559a0566dc","Type":"ContainerStarted","Data":"d05e9a9240d58a8e8e61866cbcf70300e6da40bcc5504742618e52f8f768ff23"}
Jul 23 18:32:58.085063 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:58.084813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:32:58.101553 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:32:58.101492    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7" podStartSLOduration=1.660963701 podStartE2EDuration="2.101475164s" totalImagesPullingTime="440.511463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:58.100809891 +0000 UTC m=+2139.356287130" watchObservedRunningTime="2026-07-23 18:32:58.101475164 +0000 UTC m=+2139.356952391"
Jul 23 18:33:01.258225 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:01.258186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:01.579604 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:01.579575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:01.932664 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:01.932583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:02.133748 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:02.133718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:04.095406 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.095380    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:33:04.705851 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.705812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:04.802328 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.802287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:04.803778 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.803750    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"]
Jul 23 18:33:04.807690 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.807655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.811362 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.811333    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-12054c-serving-cert\""
Jul 23 18:33:04.819954 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.819931    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"]
Jul 23 18:33:04.874356 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.874326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:04.879532 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.879510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.879661 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.879555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.879661 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.879627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf5b5\" (UniqueName: \"kubernetes.io/projected/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-kube-api-access-gf5b5\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.980329 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.980242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.980329 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.980300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.980555 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.980338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf5b5\" (UniqueName: \"kubernetes.io/projected/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-kube-api-access-gf5b5\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.980555 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:33:04.980443    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-serving-cert: secret "maas-api-e2e-inf-b-12054c-serving-cert" not found
Jul 23 18:33:04.980555 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:33:04.980519    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls podName:8f2e4d7a-34ee-4fb9-9263-a971f1ac1461 nodeName:}" failed. No retries permitted until 2026-07-23 18:33:05.480503646 +0000 UTC m=+2146.735980850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls") pod "maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" (UID: "8f2e4d7a-34ee-4fb9-9263-a971f1ac1461") : secret "maas-api-e2e-inf-b-12054c-serving-cert" not found
Jul 23 18:33:04.980947 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.980928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:04.994530 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:04.994510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf5b5\" (UniqueName: \"kubernetes.io/projected/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-kube-api-access-gf5b5\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:05.157561 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:05.157520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.439150 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:05.439110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.484930 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:05.484893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:05.487363 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:05.487336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls\") pod \"maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:05.539050 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:05.539012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.719625 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:05.719550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:05.861648 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:05.861610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"]
Jul 23 18:33:05.862823 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:33:05.862793    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2e4d7a_34ee_4fb9_9263_a971f1ac1461.slice/crio-cd7e026807028c4a1e2dd646a0c397a1749da573c924e92ed1ae8ca93468c6a4 WatchSource:0}: Error finding container cd7e026807028c4a1e2dd646a0c397a1749da573c924e92ed1ae8ca93468c6a4: Status 404 returned error can't find the container with id cd7e026807028c4a1e2dd646a0c397a1749da573c924e92ed1ae8ca93468c6a4
Jul 23 18:33:06.124415 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:06.124379    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" event={"ID":"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461","Type":"ContainerStarted","Data":"cd7e026807028c4a1e2dd646a0c397a1749da573c924e92ed1ae8ca93468c6a4"}
Jul 23 18:33:07.130256 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:07.130216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" event={"ID":"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461","Type":"ContainerStarted","Data":"3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4"}
Jul 23 18:33:07.130647 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:07.130347    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:07.150903 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:07.150852    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" podStartSLOduration=2.4053371869999998 podStartE2EDuration="3.150835903s" totalImagesPullingTime="745.498716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:33:07.148810485 +0000 UTC m=+2148.404287711" watchObservedRunningTime="2026-07-23 18:33:07.150835903 +0000 UTC m=+2148.406313129"
Jul 23 18:33:09.232164 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:09.232120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:13.139545 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:13.139467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:33:18.200104 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:18.200044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:18.299478 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:18.299422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:19.230541 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:19.230497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:26.226683 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:26.226635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:26.322737 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:26.322698    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:41.801056 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:33:41.801013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:23.972579 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:23.972541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:24.907193 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:24.907136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:25.545648 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:25.545606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:25.643764 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:25.643730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:35.451818 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.451783    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"]
Jul 23 18:34:35.452773 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.452502    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7" podUID="b5122e4a-7280-4983-88e1-5f559a0566dc" containerName="maas-api" containerID="cri-o://861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a" gracePeriod=30
Jul 23 18:34:35.484005 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.483964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:35.698057 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.698037    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:34:35.815112 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.815088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5122e4a-7280-4983-88e1-5f559a0566dc-maas-api-tls\") pod \"b5122e4a-7280-4983-88e1-5f559a0566dc\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") "
Jul 23 18:34:35.815261 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.815120    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5122e4a-7280-4983-88e1-5f559a0566dc-openshift-service-ca\") pod \"b5122e4a-7280-4983-88e1-5f559a0566dc\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") "
Jul 23 18:34:35.815261 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.815162    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw5km\" (UniqueName: \"kubernetes.io/projected/b5122e4a-7280-4983-88e1-5f559a0566dc-kube-api-access-mw5km\") pod \"b5122e4a-7280-4983-88e1-5f559a0566dc\" (UID: \"b5122e4a-7280-4983-88e1-5f559a0566dc\") "
Jul 23 18:34:35.815525 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.815504    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5122e4a-7280-4983-88e1-5f559a0566dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b5122e4a-7280-4983-88e1-5f559a0566dc" (UID: "b5122e4a-7280-4983-88e1-5f559a0566dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:34:35.817147 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.817127    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5122e4a-7280-4983-88e1-5f559a0566dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b5122e4a-7280-4983-88e1-5f559a0566dc" (UID: "b5122e4a-7280-4983-88e1-5f559a0566dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:34:35.817287 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.817266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5122e4a-7280-4983-88e1-5f559a0566dc-kube-api-access-mw5km" (OuterVolumeSpecName: "kube-api-access-mw5km") pod "b5122e4a-7280-4983-88e1-5f559a0566dc" (UID: "b5122e4a-7280-4983-88e1-5f559a0566dc"). InnerVolumeSpecName "kube-api-access-mw5km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:34:35.915754 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.915727    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5122e4a-7280-4983-88e1-5f559a0566dc-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:34:35.915754 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.915751    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5122e4a-7280-4983-88e1-5f559a0566dc-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:34:35.915754 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:35.915760    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw5km\" (UniqueName: \"kubernetes.io/projected/b5122e4a-7280-4983-88e1-5f559a0566dc-kube-api-access-mw5km\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:34:36.543518 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.543479    2560 generic.go:356] "Generic (PLEG): container finished" podID="b5122e4a-7280-4983-88e1-5f559a0566dc" containerID="861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a" exitCode=0
Jul 23 18:34:36.543518 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.543523    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"
Jul 23 18:34:36.543998 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.543538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7" event={"ID":"b5122e4a-7280-4983-88e1-5f559a0566dc","Type":"ContainerDied","Data":"861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a"}
Jul 23 18:34:36.543998 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.543588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7" event={"ID":"b5122e4a-7280-4983-88e1-5f559a0566dc","Type":"ContainerDied","Data":"d05e9a9240d58a8e8e61866cbcf70300e6da40bcc5504742618e52f8f768ff23"}
Jul 23 18:34:36.543998 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.543618    2560 scope.go:117] "RemoveContainer" containerID="861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a"
Jul 23 18:34:36.552884 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.552862    2560 scope.go:117] "RemoveContainer" containerID="861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a"
Jul 23 18:34:36.553146 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:34:36.553127    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a\": container with ID starting with 861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a not found: ID does not exist" containerID="861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a"
Jul 23 18:34:36.553195 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.553154    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a"} err="failed to get container status \"861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a\": rpc error: code = NotFound desc = could not find container \"861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a\": container with ID starting with 861269d81244e827f73b55a61686e913bca1e6ff1410db2547471a058e82e20a not found: ID does not exist"
Jul 23 18:34:36.565662 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.565638    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"]
Jul 23 18:34:36.569884 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:36.569861    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-954ecd-99f4445cd-7nmv7"]
Jul 23 18:34:37.172181 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:37.172145    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5122e4a-7280-4983-88e1-5f559a0566dc" path="/var/lib/kubelet/pods/b5122e4a-7280-4983-88e1-5f559a0566dc/volumes"
Jul 23 18:34:40.199069 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:40.199034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:40.597265 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:40.597231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:46.883378 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:46.883289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:46.984077 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:46.984046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:47.139611 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:47.139501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:47.410447 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:47.410369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:48.082793 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:48.082752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:48.184496 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:48.184462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:49.268995 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:49.268949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:57.982318 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:57.982286    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"]
Jul 23 18:34:57.984810 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:57.982493    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" podUID="8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" containerName="maas-api" containerID="cri-o://3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4" gracePeriod=30
Jul 23 18:34:58.019750 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.019719    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:58.135768 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.135717    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" podUID="8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.45:8443/health\": dial tcp 10.132.0.45:8443: connect: connection refused"
Jul 23 18:34:58.231330 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.231302    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:34:58.321400 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.321368    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf5b5\" (UniqueName: \"kubernetes.io/projected/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-kube-api-access-gf5b5\") pod \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") "
Jul 23 18:34:58.321584 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.321410    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-openshift-service-ca\") pod \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") "
Jul 23 18:34:58.321584 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.321461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls\") pod \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\" (UID: \"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461\") "
Jul 23 18:34:58.321882 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.321857    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" (UID: "8f2e4d7a-34ee-4fb9-9263-a971f1ac1461"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:34:58.323469 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.323444    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" (UID: "8f2e4d7a-34ee-4fb9-9263-a971f1ac1461"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:34:58.323469 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.323453    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-kube-api-access-gf5b5" (OuterVolumeSpecName: "kube-api-access-gf5b5") pod "8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" (UID: "8f2e4d7a-34ee-4fb9-9263-a971f1ac1461"). InnerVolumeSpecName "kube-api-access-gf5b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:34:58.422162 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.422138    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:34:58.422162 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.422161    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:34:58.422319 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.422170    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf5b5\" (UniqueName: \"kubernetes.io/projected/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461-kube-api-access-gf5b5\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:34:58.653217 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.653119    2560 generic.go:356] "Generic (PLEG): container finished" podID="8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" containerID="3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4" exitCode=0
Jul 23 18:34:58.653217 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.653158    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"
Jul 23 18:34:58.653420 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.653217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" event={"ID":"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461","Type":"ContainerDied","Data":"3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4"}
Jul 23 18:34:58.653420 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.653266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq" event={"ID":"8f2e4d7a-34ee-4fb9-9263-a971f1ac1461","Type":"ContainerDied","Data":"cd7e026807028c4a1e2dd646a0c397a1749da573c924e92ed1ae8ca93468c6a4"}
Jul 23 18:34:58.653420 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.653288    2560 scope.go:117] "RemoveContainer" containerID="3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4"
Jul 23 18:34:58.661949 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.661933    2560 scope.go:117] "RemoveContainer" containerID="3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4"
Jul 23 18:34:58.662171 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:34:58.662154    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4\": container with ID starting with 3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4 not found: ID does not exist" containerID="3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4"
Jul 23 18:34:58.662218 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.662180    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4"} err="failed to get container status \"3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4\": rpc error: code = NotFound desc = could not find container \"3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4\": container with ID starting with 3103a7c5c46b7688f85dc1945428caaf6df020aa895ae4ef5231688c6ce166b4 not found: ID does not exist"
Jul 23 18:34:58.675144 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.675121    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"]
Jul 23 18:34:58.679272 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:58.679253    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12054c-5cf79fb6c8-6rzxq"]
Jul 23 18:34:59.172746 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:34:59.172712    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" path="/var/lib/kubelet/pods/8f2e4d7a-34ee-4fb9-9263-a971f1ac1461/volumes"
Jul 23 18:35:02.626447 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:02.626408    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:03.049031 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:03.048995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.610475 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:09.610439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.715631 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:09.715598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.922210 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:09.922122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:10.179580 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:10.179465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:10.542266 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:10.542236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:10.911036 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:10.910923    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:11.307116 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:11.307082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:13.481704 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.481644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:13.577540 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.577492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:13.667390 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.667354    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"]
Jul 23 18:35:13.667761 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.667748    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5122e4a-7280-4983-88e1-5f559a0566dc" containerName="maas-api"
Jul 23 18:35:13.667815 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.667763    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5122e4a-7280-4983-88e1-5f559a0566dc" containerName="maas-api"
Jul 23 18:35:13.667815 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.667777    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" containerName="maas-api"
Jul 23 18:35:13.667815 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.667784    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" containerName="maas-api"
Jul 23 18:35:13.667918 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.667858    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5122e4a-7280-4983-88e1-5f559a0566dc" containerName="maas-api"
Jul 23 18:35:13.667918 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.667867    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f2e4d7a-34ee-4fb9-9263-a971f1ac1461" containerName="maas-api"
Jul 23 18:35:13.672511 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.672488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.676919 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.676895    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-debfbc-serving-cert\""
Jul 23 18:35:13.685397 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.685372    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"]
Jul 23 18:35:13.728829 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.728792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:13.758715 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.758617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.758715 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.758666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj5sh\" (UniqueName: \"kubernetes.io/projected/7b81e482-25cb-4ed3-adda-e232551c0625-kube-api-access-vj5sh\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.758916 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.758720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b81e482-25cb-4ed3-adda-e232551c0625-openshift-service-ca\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.859840 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.859795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.859840 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.859841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj5sh\" (UniqueName: \"kubernetes.io/projected/7b81e482-25cb-4ed3-adda-e232551c0625-kube-api-access-vj5sh\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.860058 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.859861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b81e482-25cb-4ed3-adda-e232551c0625-openshift-service-ca\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.860058 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:35:13.859956    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-serving-cert: secret "maas-api-e2e-api-a-debfbc-serving-cert" not found
Jul 23 18:35:13.860058 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:35:13.860037    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls podName:7b81e482-25cb-4ed3-adda-e232551c0625 nodeName:}" failed. No retries permitted until 2026-07-23 18:35:14.360019603 +0000 UTC m=+2275.615496825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls") pod "maas-api-e2e-api-a-debfbc-799f99b977-b8bd2" (UID: "7b81e482-25cb-4ed3-adda-e232551c0625") : secret "maas-api-e2e-api-a-debfbc-serving-cert" not found
Jul 23 18:35:13.860462 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.860445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b81e482-25cb-4ed3-adda-e232551c0625-openshift-service-ca\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:13.869301 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:13.869279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj5sh\" (UniqueName: \"kubernetes.io/projected/7b81e482-25cb-4ed3-adda-e232551c0625-kube-api-access-vj5sh\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:14.024554 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.024460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:14.249470 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.249424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:14.350117 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.350075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:14.365235 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.365203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:14.367759 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.367738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls\") pod \"maas-api-e2e-api-a-debfbc-799f99b977-b8bd2\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:14.583791 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.583760    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:14.740271 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:35:14.740241    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b81e482_25cb_4ed3_adda_e232551c0625.slice/crio-6e11d6b2e3e4e8cfd7ed92df1fe2f076c59c715deadd6cfd1f2b369e2e60ce6e WatchSource:0}: Error finding container 6e11d6b2e3e4e8cfd7ed92df1fe2f076c59c715deadd6cfd1f2b369e2e60ce6e: Status 404 returned error can't find the container with id 6e11d6b2e3e4e8cfd7ed92df1fe2f076c59c715deadd6cfd1f2b369e2e60ce6e
Jul 23 18:35:14.741646 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.741625    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:35:14.749197 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:14.749176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"]
Jul 23 18:35:15.742449 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:15.742405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2" event={"ID":"7b81e482-25cb-4ed3-adda-e232551c0625","Type":"ContainerStarted","Data":"db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1"}
Jul 23 18:35:15.742872 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:15.742487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2" event={"ID":"7b81e482-25cb-4ed3-adda-e232551c0625","Type":"ContainerStarted","Data":"6e11d6b2e3e4e8cfd7ed92df1fe2f076c59c715deadd6cfd1f2b369e2e60ce6e"}
Jul 23 18:35:15.742872 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:15.742560    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:15.762781 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:15.762729    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2" podStartSLOduration=2.333550357 podStartE2EDuration="2.762713714s" totalImagesPullingTime="429.163357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:15.760191284 +0000 UTC m=+2277.015668509" watchObservedRunningTime="2026-07-23 18:35:15.762713714 +0000 UTC m=+2277.018190941"
Jul 23 18:35:17.982337 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:17.982295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:18.500854 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:18.500817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:18.833718 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:18.833658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:19.010071 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:19.010036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:21.492848 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.492816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:21.569830 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.569794    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"]
Jul 23 18:35:21.578295 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.578256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.581522 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.581484    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0bce45-serving-cert\""
Jul 23 18:35:21.585426 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.585336    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"]
Jul 23 18:35:21.602881 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.602846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:21.641041 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.641009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.641156 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.641065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3875ded-19f3-4e14-8886-9332b171373d-openshift-service-ca\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.641156 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.641090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8592\" (UniqueName: \"kubernetes.io/projected/c3875ded-19f3-4e14-8886-9332b171373d-kube-api-access-n8592\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.699661 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.699624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:21.742256 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.742224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.742394 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.742275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3875ded-19f3-4e14-8886-9332b171373d-openshift-service-ca\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.742394 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.742293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8592\" (UniqueName: \"kubernetes.io/projected/c3875ded-19f3-4e14-8886-9332b171373d-kube-api-access-n8592\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.742394 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:35:21.742385    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-serving-cert: secret "maas-api-e2e-api-b-0bce45-serving-cert" not found
Jul 23 18:35:21.742506 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:35:21.742473    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls podName:c3875ded-19f3-4e14-8886-9332b171373d nodeName:}" failed. No retries permitted until 2026-07-23 18:35:22.24245329 +0000 UTC m=+2283.497930497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls") pod "maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw" (UID: "c3875ded-19f3-4e14-8886-9332b171373d") : secret "maas-api-e2e-api-b-0bce45-serving-cert" not found
Jul 23 18:35:21.743021 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.742978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3875ded-19f3-4e14-8886-9332b171373d-openshift-service-ca\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.752949 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.752929    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:21.754576 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.754551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8592\" (UniqueName: \"kubernetes.io/projected/c3875ded-19f3-4e14-8886-9332b171373d-kube-api-access-n8592\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:21.845600 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:21.845567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:22.247376 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:22.247341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:22.250079 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:22.250054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls\") pod \"maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:22.279130 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:22.279099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:22.379965 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:22.379927    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:22.494859 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:22.494825    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:22.637353 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:22.637327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"]
Jul 23 18:35:22.639275 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:35:22.639247    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3875ded_19f3_4e14_8886_9332b171373d.slice/crio-0d3fe913f4be6b6451751a0e18e9f6fc9821b870f7702ed1ef5c242dcbe27639 WatchSource:0}: Error finding container 0d3fe913f4be6b6451751a0e18e9f6fc9821b870f7702ed1ef5c242dcbe27639: Status 404 returned error can't find the container with id 0d3fe913f4be6b6451751a0e18e9f6fc9821b870f7702ed1ef5c242dcbe27639
Jul 23 18:35:22.775050 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:22.774965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw" event={"ID":"c3875ded-19f3-4e14-8886-9332b171373d","Type":"ContainerStarted","Data":"0d3fe913f4be6b6451751a0e18e9f6fc9821b870f7702ed1ef5c242dcbe27639"}
Jul 23 18:35:23.782013 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:23.781974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw" event={"ID":"c3875ded-19f3-4e14-8886-9332b171373d","Type":"ContainerStarted","Data":"a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946"}
Jul 23 18:35:23.782416 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:23.782085    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:23.800645 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:23.800597    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw" podStartSLOduration=2.400049091 podStartE2EDuration="2.800583406s" totalImagesPullingTime="400.534315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:23.798818107 +0000 UTC m=+2285.054295335" watchObservedRunningTime="2026-07-23 18:35:23.800583406 +0000 UTC m=+2285.056060632"
Jul 23 18:35:26.054909 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:26.054870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:29.792686 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:29.792651    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:35:34.930228 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:34.930179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:35.029199 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:35.029159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:43.156047 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:43.156005    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:43.256351 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:43.256315    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:44.894131 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:44.894092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:44.994870 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:44.994834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:50.142718 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.142662    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"]
Jul 23 18:35:50.143111 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.142968    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2" podUID="7b81e482-25cb-4ed3-adda-e232551c0625" containerName="maas-api" containerID="cri-o://db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1" gracePeriod=30
Jul 23 18:35:50.174648 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.174609    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:50.398899 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.398839    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:50.511487 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.511454    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b81e482-25cb-4ed3-adda-e232551c0625-openshift-service-ca\") pod \"7b81e482-25cb-4ed3-adda-e232551c0625\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") "
Jul 23 18:35:50.511666 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.511497    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls\") pod \"7b81e482-25cb-4ed3-adda-e232551c0625\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") "
Jul 23 18:35:50.511666 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.511537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj5sh\" (UniqueName: \"kubernetes.io/projected/7b81e482-25cb-4ed3-adda-e232551c0625-kube-api-access-vj5sh\") pod \"7b81e482-25cb-4ed3-adda-e232551c0625\" (UID: \"7b81e482-25cb-4ed3-adda-e232551c0625\") "
Jul 23 18:35:50.511870 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.511847    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b81e482-25cb-4ed3-adda-e232551c0625-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7b81e482-25cb-4ed3-adda-e232551c0625" (UID: "7b81e482-25cb-4ed3-adda-e232551c0625"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:35:50.513697 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.513659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7b81e482-25cb-4ed3-adda-e232551c0625" (UID: "7b81e482-25cb-4ed3-adda-e232551c0625"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:35:50.513797 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.513776    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b81e482-25cb-4ed3-adda-e232551c0625-kube-api-access-vj5sh" (OuterVolumeSpecName: "kube-api-access-vj5sh") pod "7b81e482-25cb-4ed3-adda-e232551c0625" (UID: "7b81e482-25cb-4ed3-adda-e232551c0625"). InnerVolumeSpecName "kube-api-access-vj5sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:35:50.612408 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.612383    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b81e482-25cb-4ed3-adda-e232551c0625-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:35:50.612408 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.612406    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b81e482-25cb-4ed3-adda-e232551c0625-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:35:50.612565 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.612415    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj5sh\" (UniqueName: \"kubernetes.io/projected/7b81e482-25cb-4ed3-adda-e232551c0625-kube-api-access-vj5sh\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:35:50.922416 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.922377    2560 generic.go:356] "Generic (PLEG): container finished" podID="7b81e482-25cb-4ed3-adda-e232551c0625" containerID="db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1" exitCode=0
Jul 23 18:35:50.922619 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.922426    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"
Jul 23 18:35:50.922619 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.922442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2" event={"ID":"7b81e482-25cb-4ed3-adda-e232551c0625","Type":"ContainerDied","Data":"db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1"}
Jul 23 18:35:50.922619 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.922484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2" event={"ID":"7b81e482-25cb-4ed3-adda-e232551c0625","Type":"ContainerDied","Data":"6e11d6b2e3e4e8cfd7ed92df1fe2f076c59c715deadd6cfd1f2b369e2e60ce6e"}
Jul 23 18:35:50.922619 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.922505    2560 scope.go:117] "RemoveContainer" containerID="db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1"
Jul 23 18:35:50.931728 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.931707    2560 scope.go:117] "RemoveContainer" containerID="db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1"
Jul 23 18:35:50.932037 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:35:50.932016    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1\": container with ID starting with db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1 not found: ID does not exist" containerID="db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1"
Jul 23 18:35:50.932109 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.932051    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1"} err="failed to get container status \"db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1\": rpc error: code = NotFound desc = could not find container \"db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1\": container with ID starting with db7b49f22ecb81756dedaeff589044a338e19eb28c49d7721fe781cf4b9fb3e1 not found: ID does not exist"
Jul 23 18:35:50.943896 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.943870    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"]
Jul 23 18:35:50.948084 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:50.948060    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-debfbc-799f99b977-b8bd2"]
Jul 23 18:35:51.172465 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:51.172384    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b81e482-25cb-4ed3-adda-e232551c0625" path="/var/lib/kubelet/pods/7b81e482-25cb-4ed3-adda-e232551c0625/volumes"
Jul 23 18:35:54.359220 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:54.359184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:54.784071 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:35:54.783986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:00.978431 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:00.978389    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:01.053354 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:01.053324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:01.344876 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:01.344843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:01.623116 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:01.623029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:02.275083 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:02.275037    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:02.398466 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:02.398434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:17.184990 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.184899    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"]
Jul 23 18:36:17.185657 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.185127    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw" podUID="c3875ded-19f3-4e14-8886-9332b171373d" containerName="maas-api" containerID="cri-o://a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946" gracePeriod=30
Jul 23 18:36:17.218488 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.218452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:17.440907 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.440844    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:36:17.549936 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.549896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8592\" (UniqueName: \"kubernetes.io/projected/c3875ded-19f3-4e14-8886-9332b171373d-kube-api-access-n8592\") pod \"c3875ded-19f3-4e14-8886-9332b171373d\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") "
Jul 23 18:36:17.550142 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.550004    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls\") pod \"c3875ded-19f3-4e14-8886-9332b171373d\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") "
Jul 23 18:36:17.550217 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.550137    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3875ded-19f3-4e14-8886-9332b171373d-openshift-service-ca\") pod \"c3875ded-19f3-4e14-8886-9332b171373d\" (UID: \"c3875ded-19f3-4e14-8886-9332b171373d\") "
Jul 23 18:36:17.550522 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.550492    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3875ded-19f3-4e14-8886-9332b171373d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3875ded-19f3-4e14-8886-9332b171373d" (UID: "c3875ded-19f3-4e14-8886-9332b171373d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:36:17.552105 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.552076    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3875ded-19f3-4e14-8886-9332b171373d" (UID: "c3875ded-19f3-4e14-8886-9332b171373d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:36:17.552212 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.552126    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3875ded-19f3-4e14-8886-9332b171373d-kube-api-access-n8592" (OuterVolumeSpecName: "kube-api-access-n8592") pod "c3875ded-19f3-4e14-8886-9332b171373d" (UID: "c3875ded-19f3-4e14-8886-9332b171373d"). InnerVolumeSpecName "kube-api-access-n8592". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:36:17.651540 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.651494    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3875ded-19f3-4e14-8886-9332b171373d-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:36:17.651540 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.651532    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8592\" (UniqueName: \"kubernetes.io/projected/c3875ded-19f3-4e14-8886-9332b171373d-kube-api-access-n8592\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:36:17.651540 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:17.651547    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3875ded-19f3-4e14-8886-9332b171373d-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:36:18.059111 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.059074    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3875ded-19f3-4e14-8886-9332b171373d" containerID="a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946" exitCode=0
Jul 23 18:36:18.059301 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.059127    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"
Jul 23 18:36:18.059301 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.059160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw" event={"ID":"c3875ded-19f3-4e14-8886-9332b171373d","Type":"ContainerDied","Data":"a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946"}
Jul 23 18:36:18.059301 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.059217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw" event={"ID":"c3875ded-19f3-4e14-8886-9332b171373d","Type":"ContainerDied","Data":"0d3fe913f4be6b6451751a0e18e9f6fc9821b870f7702ed1ef5c242dcbe27639"}
Jul 23 18:36:18.059301 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.059240    2560 scope.go:117] "RemoveContainer" containerID="a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946"
Jul 23 18:36:18.068989 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.068969    2560 scope.go:117] "RemoveContainer" containerID="a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946"
Jul 23 18:36:18.069228 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:36:18.069210    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946\": container with ID starting with a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946 not found: ID does not exist" containerID="a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946"
Jul 23 18:36:18.069280 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.069236    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946"} err="failed to get container status \"a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946\": rpc error: code = NotFound desc = could not find container \"a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946\": container with ID starting with a6ebcf9f9aca9f4be6e0850509193643937a931f3828356c91cd4062397c7946 not found: ID does not exist"
Jul 23 18:36:18.085210 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.085186    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"]
Jul 23 18:36:18.089848 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:18.089824    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0bce45-5dc9c68995-m7qcw"]
Jul 23 18:36:19.172025 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:19.171990    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3875ded-19f3-4e14-8886-9332b171373d" path="/var/lib/kubelet/pods/c3875ded-19f3-4e14-8886-9332b171373d/volumes"
Jul 23 18:36:22.276009 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:22.275975    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:22.385059 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:22.385020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:22.586462 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:22.586417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:22.684535 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:22.684500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:28.327469 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:28.327432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:28.426394 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:28.426357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:28.596928 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:28.596839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:28.832128 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:28.832093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:29.203937 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:29.203898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:29.990971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:29.990932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:30.104578 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:30.104539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:33.000192 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.000154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:33.073878 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.073843    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"]
Jul 23 18:36:33.074257 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.074242    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3875ded-19f3-4e14-8886-9332b171373d" containerName="maas-api"
Jul 23 18:36:33.074323 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.074259    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3875ded-19f3-4e14-8886-9332b171373d" containerName="maas-api"
Jul 23 18:36:33.074323 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.074284    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b81e482-25cb-4ed3-adda-e232551c0625" containerName="maas-api"
Jul 23 18:36:33.074323 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.074294    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b81e482-25cb-4ed3-adda-e232551c0625" containerName="maas-api"
Jul 23 18:36:33.074488 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.074366    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3875ded-19f3-4e14-8886-9332b171373d" containerName="maas-api"
Jul 23 18:36:33.074488 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.074379    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b81e482-25cb-4ed3-adda-e232551c0625" containerName="maas-api"
Jul 23 18:36:33.077571 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.077549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.080136 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.080115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e94d59-serving-cert\""
Jul 23 18:36:33.092480 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.092455    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"]
Jul 23 18:36:33.101552 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.101516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/887160a3-1eab-4d5b-8941-8d47b55cfff5-maas-api-tls\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.101706 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.101619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/887160a3-1eab-4d5b-8941-8d47b55cfff5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.101706 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.101641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4qf9\" (UniqueName: \"kubernetes.io/projected/887160a3-1eab-4d5b-8941-8d47b55cfff5-kube-api-access-f4qf9\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.106276 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.106248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:33.202407 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.202368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/887160a3-1eab-4d5b-8941-8d47b55cfff5-maas-api-tls\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.202616 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.202501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/887160a3-1eab-4d5b-8941-8d47b55cfff5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.202616 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.202534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4qf9\" (UniqueName: \"kubernetes.io/projected/887160a3-1eab-4d5b-8941-8d47b55cfff5-kube-api-access-f4qf9\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.203296 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.203275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/887160a3-1eab-4d5b-8941-8d47b55cfff5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.204953 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.204933    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/887160a3-1eab-4d5b-8941-8d47b55cfff5-maas-api-tls\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.205531 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.205503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:33.211792 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.211762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4qf9\" (UniqueName: \"kubernetes.io/projected/887160a3-1eab-4d5b-8941-8d47b55cfff5-kube-api-access-f4qf9\") pod \"maas-api-e2e-shared-a-e94d59-687c769546-2w76k\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.303776 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.303738    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:33.387851 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.387821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:33.521868 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.521845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"]
Jul 23 18:36:33.523798 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:36:33.523771    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887160a3_1eab_4d5b_8941_8d47b55cfff5.slice/crio-898c0e43722c1edb76804416db91b7543dba257da4b35f9d6f498389abc25b16 WatchSource:0}: Error finding container 898c0e43722c1edb76804416db91b7543dba257da4b35f9d6f498389abc25b16: Status 404 returned error can't find the container with id 898c0e43722c1edb76804416db91b7543dba257da4b35f9d6f498389abc25b16
Jul 23 18:36:33.787087 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:33.787052    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:34.136661 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:34.136582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k" event={"ID":"887160a3-1eab-4d5b-8941-8d47b55cfff5","Type":"ContainerStarted","Data":"898c0e43722c1edb76804416db91b7543dba257da4b35f9d6f498389abc25b16"}
Jul 23 18:36:34.437651 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:34.437557    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:35.143071 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:35.142978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k" event={"ID":"887160a3-1eab-4d5b-8941-8d47b55cfff5","Type":"ContainerStarted","Data":"8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920"}
Jul 23 18:36:35.143071 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:35.143045    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:35.161952 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:35.161906    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k" podStartSLOduration=0.85700734 podStartE2EDuration="2.161891383s" totalImagesPullingTime="1.304884043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:35.160457946 +0000 UTC m=+2356.415935172" watchObservedRunningTime="2026-07-23 18:36:35.161891383 +0000 UTC m=+2356.417368609"
Jul 23 18:36:37.518642 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:37.518590    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:37.879452 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:37.879409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:38.216755 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:38.216630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:38.406525 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:38.406490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:40.974591 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:40.974544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:41.072063 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.072027    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:41.155141 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.155108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:36:41.162600 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.162571    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"]
Jul 23 18:36:41.166236 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.166213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.171660 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.171641    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f5044c-serving-cert\""
Jul 23 18:36:41.181340 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.181317    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"]
Jul 23 18:36:41.235904 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.235820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:41.281169 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.281138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8e58c-188c-47dc-b586-302e5627c4c6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.281319 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.281180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd8e58c-188c-47dc-b586-302e5627c4c6-maas-api-tls\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.281319 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.281236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v595\" (UniqueName: \"kubernetes.io/projected/3bd8e58c-188c-47dc-b586-302e5627c4c6-kube-api-access-7v595\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.369455 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.369416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:41.382462 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.382439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8e58c-188c-47dc-b586-302e5627c4c6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.382572 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.382481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd8e58c-188c-47dc-b586-302e5627c4c6-maas-api-tls\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.382740 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.382715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v595\" (UniqueName: \"kubernetes.io/projected/3bd8e58c-188c-47dc-b586-302e5627c4c6-kube-api-access-7v595\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.383155 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.383133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8e58c-188c-47dc-b586-302e5627c4c6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.384899 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.384872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd8e58c-188c-47dc-b586-302e5627c4c6-maas-api-tls\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.395650 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.395628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v595\" (UniqueName: \"kubernetes.io/projected/3bd8e58c-188c-47dc-b586-302e5627c4c6-kube-api-access-7v595\") pod \"maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.479062 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.479031    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:41.624481 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.624457    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"]
Jul 23 18:36:41.626990 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:36:41.626960    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd8e58c_188c_47dc_b586_302e5627c4c6.slice/crio-9a220e39f28571a8674d02d31893f8a05cda5dd32a12bdbb972d9890abde4521 WatchSource:0}: Error finding container 9a220e39f28571a8674d02d31893f8a05cda5dd32a12bdbb972d9890abde4521: Status 404 returned error can't find the container with id 9a220e39f28571a8674d02d31893f8a05cda5dd32a12bdbb972d9890abde4521
Jul 23 18:36:41.764603 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.764521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:41.868141 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:41.868104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:42.178041 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:42.178007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv" event={"ID":"3bd8e58c-188c-47dc-b586-302e5627c4c6","Type":"ContainerStarted","Data":"6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203"}
Jul 23 18:36:42.178414 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:42.178053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv" event={"ID":"3bd8e58c-188c-47dc-b586-302e5627c4c6","Type":"ContainerStarted","Data":"9a220e39f28571a8674d02d31893f8a05cda5dd32a12bdbb972d9890abde4521"}
Jul 23 18:36:42.178414 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:42.178112    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:42.201396 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:42.201342    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv" podStartSLOduration=0.833173913 podStartE2EDuration="1.201327389s" totalImagesPullingTime="368.153476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:42.200153702 +0000 UTC m=+2363.455630956" watchObservedRunningTime="2026-07-23 18:36:42.201327389 +0000 UTC m=+2363.456804615"
Jul 23 18:36:44.912887 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:44.912855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:44.978902 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:44.978872    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:45.507352 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:45.507310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:48.188037 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:48.188010    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:36:55.690163 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:55.690121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:55.792763 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:55.792726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:58.569498 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:36:58.569458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:02.689577 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:37:02.689533    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:02.787447 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:37:02.787409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:09.613083 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:37:09.613041    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:09.713419 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:37:09.713374    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:19.325360 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:37:19.325334    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:37:19.333447 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:37:19.333425    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:37:55.701614 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:37:55.701514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:00.759031 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:38:00.758987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:14.204554 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:38:14.204513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:59.255833 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:39:59.255802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:00.457830 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:40:00.457779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:02.959413 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:40:02.959380    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:18.127517 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:40:18.127448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:00.469825 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:00.469749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:02.340536 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:02.340505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:10.462259 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:10.462219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:23.771202 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:23.771169    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:23.897176 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:23.897144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:39.547362 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:39.547322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:56.686413 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:56.686376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:56.785048 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:41:56.785016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:03.740737 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:03.740700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:03.827081 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:03.827034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:19.354128 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:19.354044    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:42:19.363823 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:19.363800    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:42:34.520632 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:34.520598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:34.622525 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:34.622491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:36.778334 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:36.778297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:37.732299 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:37.732262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:42.447933 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:42.447903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:42.537066 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:42.537036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:55.880161 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:55.880130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:55.975720 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:42:55.975689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:05.523560 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.523524    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"]
Jul 23 18:43:05.524084 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.523775    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k" podUID="887160a3-1eab-4d5b-8941-8d47b55cfff5" containerName="maas-api" containerID="cri-o://8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920" gracePeriod=30
Jul 23 18:43:05.548491 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.548466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:05.773872 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.773818    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:43:05.882197 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.882164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4qf9\" (UniqueName: \"kubernetes.io/projected/887160a3-1eab-4d5b-8941-8d47b55cfff5-kube-api-access-f4qf9\") pod \"887160a3-1eab-4d5b-8941-8d47b55cfff5\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") "
Jul 23 18:43:05.882374 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.882231    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/887160a3-1eab-4d5b-8941-8d47b55cfff5-openshift-service-ca\") pod \"887160a3-1eab-4d5b-8941-8d47b55cfff5\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") "
Jul 23 18:43:05.882374 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.882306    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/887160a3-1eab-4d5b-8941-8d47b55cfff5-maas-api-tls\") pod \"887160a3-1eab-4d5b-8941-8d47b55cfff5\" (UID: \"887160a3-1eab-4d5b-8941-8d47b55cfff5\") "
Jul 23 18:43:05.882583 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.882558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/887160a3-1eab-4d5b-8941-8d47b55cfff5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "887160a3-1eab-4d5b-8941-8d47b55cfff5" (UID: "887160a3-1eab-4d5b-8941-8d47b55cfff5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:43:05.884222 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.884199    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887160a3-1eab-4d5b-8941-8d47b55cfff5-kube-api-access-f4qf9" (OuterVolumeSpecName: "kube-api-access-f4qf9") pod "887160a3-1eab-4d5b-8941-8d47b55cfff5" (UID: "887160a3-1eab-4d5b-8941-8d47b55cfff5"). InnerVolumeSpecName "kube-api-access-f4qf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:43:05.884361 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.884343    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887160a3-1eab-4d5b-8941-8d47b55cfff5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "887160a3-1eab-4d5b-8941-8d47b55cfff5" (UID: "887160a3-1eab-4d5b-8941-8d47b55cfff5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:43:05.983876 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.983848    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/887160a3-1eab-4d5b-8941-8d47b55cfff5-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:43:05.983876 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.983873    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4qf9\" (UniqueName: \"kubernetes.io/projected/887160a3-1eab-4d5b-8941-8d47b55cfff5-kube-api-access-f4qf9\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:43:05.984030 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:05.983882    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/887160a3-1eab-4d5b-8941-8d47b55cfff5-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:43:06.014892 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.014867    2560 generic.go:356] "Generic (PLEG): container finished" podID="887160a3-1eab-4d5b-8941-8d47b55cfff5" containerID="8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920" exitCode=0
Jul 23 18:43:06.015023 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.014924    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k" event={"ID":"887160a3-1eab-4d5b-8941-8d47b55cfff5","Type":"ContainerDied","Data":"8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920"}
Jul 23 18:43:06.015023 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.014959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k" event={"ID":"887160a3-1eab-4d5b-8941-8d47b55cfff5","Type":"ContainerDied","Data":"898c0e43722c1edb76804416db91b7543dba257da4b35f9d6f498389abc25b16"}
Jul 23 18:43:06.015023 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.014980    2560 scope.go:117] "RemoveContainer" containerID="8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920"
Jul 23 18:43:06.015023 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.014924    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"
Jul 23 18:43:06.024589 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.024565    2560 scope.go:117] "RemoveContainer" containerID="8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920"
Jul 23 18:43:06.024930 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:43:06.024906    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920\": container with ID starting with 8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920 not found: ID does not exist" containerID="8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920"
Jul 23 18:43:06.025007 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.024942    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920"} err="failed to get container status \"8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920\": rpc error: code = NotFound desc = could not find container \"8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920\": container with ID starting with 8ec141facc7d3c8775ec0077e7a865f2ad523b4ebf4eea97b8e8af9cba681920 not found: ID does not exist"
Jul 23 18:43:06.039410 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.039385    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"]
Jul 23 18:43:06.041136 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:06.041118    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e94d59-687c769546-2w76k"]
Jul 23 18:43:07.172268 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:07.172234    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="887160a3-1eab-4d5b-8941-8d47b55cfff5" path="/var/lib/kubelet/pods/887160a3-1eab-4d5b-8941-8d47b55cfff5/volumes"
Jul 23 18:43:10.234706 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:10.234653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:10.657352 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:10.657321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:17.128754 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:17.128723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:17.247852 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:17.247817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:17.456053 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:17.455961    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:17.723187 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:17.723098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:18.379939 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:18.379882    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:18.478838 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:18.478804    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:28.424105 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.424068    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"]
Jul 23 18:43:28.424628 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.424275    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv" podUID="3bd8e58c-188c-47dc-b586-302e5627c4c6" containerName="maas-api" containerID="cri-o://6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203" gracePeriod=30
Jul 23 18:43:28.451147 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.451117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:28.677809 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.677740    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:43:28.783148 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.783109    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd8e58c-188c-47dc-b586-302e5627c4c6-maas-api-tls\") pod \"3bd8e58c-188c-47dc-b586-302e5627c4c6\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") "
Jul 23 18:43:28.783148 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.783156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8e58c-188c-47dc-b586-302e5627c4c6-openshift-service-ca\") pod \"3bd8e58c-188c-47dc-b586-302e5627c4c6\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") "
Jul 23 18:43:28.783412 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.783231    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v595\" (UniqueName: \"kubernetes.io/projected/3bd8e58c-188c-47dc-b586-302e5627c4c6-kube-api-access-7v595\") pod \"3bd8e58c-188c-47dc-b586-302e5627c4c6\" (UID: \"3bd8e58c-188c-47dc-b586-302e5627c4c6\") "
Jul 23 18:43:28.783587 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.783563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bd8e58c-188c-47dc-b586-302e5627c4c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3bd8e58c-188c-47dc-b586-302e5627c4c6" (UID: "3bd8e58c-188c-47dc-b586-302e5627c4c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:43:28.785225 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.785204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd8e58c-188c-47dc-b586-302e5627c4c6-kube-api-access-7v595" (OuterVolumeSpecName: "kube-api-access-7v595") pod "3bd8e58c-188c-47dc-b586-302e5627c4c6" (UID: "3bd8e58c-188c-47dc-b586-302e5627c4c6"). InnerVolumeSpecName "kube-api-access-7v595". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:43:28.785312 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.785225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bd8e58c-188c-47dc-b586-302e5627c4c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3bd8e58c-188c-47dc-b586-302e5627c4c6" (UID: "3bd8e58c-188c-47dc-b586-302e5627c4c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:43:28.883971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.883918    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd8e58c-188c-47dc-b586-302e5627c4c6-maas-api-tls\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:43:28.883971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.883964    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8e58c-188c-47dc-b586-302e5627c4c6-openshift-service-ca\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:43:28.883971 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:28.883974    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v595\" (UniqueName: \"kubernetes.io/projected/3bd8e58c-188c-47dc-b586-302e5627c4c6-kube-api-access-7v595\") on node \"ip-10-0-129-71.ec2.internal\" DevicePath \"\""
Jul 23 18:43:29.123019 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.122986    2560 generic.go:356] "Generic (PLEG): container finished" podID="3bd8e58c-188c-47dc-b586-302e5627c4c6" containerID="6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203" exitCode=0
Jul 23 18:43:29.123188 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.123029    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"
Jul 23 18:43:29.123188 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.123077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv" event={"ID":"3bd8e58c-188c-47dc-b586-302e5627c4c6","Type":"ContainerDied","Data":"6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203"}
Jul 23 18:43:29.123188 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.123135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv" event={"ID":"3bd8e58c-188c-47dc-b586-302e5627c4c6","Type":"ContainerDied","Data":"9a220e39f28571a8674d02d31893f8a05cda5dd32a12bdbb972d9890abde4521"}
Jul 23 18:43:29.123188 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.123164    2560 scope.go:117] "RemoveContainer" containerID="6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203"
Jul 23 18:43:29.132380 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.132363    2560 scope.go:117] "RemoveContainer" containerID="6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203"
Jul 23 18:43:29.132648 ip-10-0-129-71 kubenswrapper[2560]: E0723 18:43:29.132625    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203\": container with ID starting with 6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203 not found: ID does not exist" containerID="6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203"
Jul 23 18:43:29.132770 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.132653    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203"} err="failed to get container status \"6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203\": rpc error: code = NotFound desc = could not find container \"6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203\": container with ID starting with 6ad58fdf08006cb2cad80fffa60787d87bedc3992c65cee3185d47c8847bd203 not found: ID does not exist"
Jul 23 18:43:29.146711 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.146685    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"]
Jul 23 18:43:29.157248 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.157212    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f5044c-6b7bcff469-rgncv"]
Jul 23 18:43:29.172128 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:29.172099    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bd8e58c-188c-47dc-b586-302e5627c4c6" path="/var/lib/kubelet/pods/3bd8e58c-188c-47dc-b586-302e5627c4c6/volumes"
Jul 23 18:43:32.920846 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:32.920810    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:33.331510 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:33.331473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:39.678036 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:39.677993    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:39.745493 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:39.745445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:39.994353 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:39.994274    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:40.235871 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:40.235838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:46.620326 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:46.620249    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cf75b947b-l5dkd_25908a53-2ed8-4be1-9663-37ce13aada77/manager/0.log"
Jul 23 18:43:47.004728 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:47.004653    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-6ksjc_043a2e63-e15b-47f1-87b8-e25188e22ddb/copy-manifests/0.log"
Jul 23 18:43:47.018922 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:47.018884    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-6ksjc_043a2e63-e15b-47f1-87b8-e25188e22ddb/manager/0.log"
Jul 23 18:43:47.533363 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:47.533326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:47.646255 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:47.646222    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5dbbf89774-7szs9_a402ae06-bef1-47bb-a12e-ff6f81453880/maas-api/0.log"
Jul 23 18:43:47.744383 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:47.744348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:48.005344 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:48.005317    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rjbsz_eb8a72ff-e567-4ed2-b4ff-49a1e55bed56/postgres/0.log"
Jul 23 18:43:50.793584 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:50.793553    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rnm2f_39ee8c73-bb31-4171-8f04-f0396ef02e4a/discovery/0.log"
Jul 23 18:43:51.267308 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:51.267233    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mvm4g_156b94bc-8345-49f2-a6c8-7e48725bbe31/payload-pre-processing/0.log"
Jul 23 18:43:51.389665 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:51.389630    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hwfn6_0f91ff38-3352-4dfb-b4b0-8f470c6db5a1/payload-processing/0.log"
Jul 23 18:43:51.981311 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:51.981282    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bksxx_0bab693c-5342-4f37-8022-ed2938693897/main/0.log"
Jul 23 18:43:52.348079 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:52.348046    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bz6lr_652cd22d-70a3-4136-8c6a-f403506a2110/main/0.log"
Jul 23 18:43:58.814858 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:58.814823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:58.904762 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:43:58.904727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log" limit=1024
Jul 23 18:44:02.185614 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:02.185585    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hwfr9_67ada2d4-7c84-4cd2-ade4-67ceac12ea6e/global-pull-secret-syncer/0.log"
Jul 23 18:44:02.363116 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:02.363082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4c6fs_4830057f-27c4-41b5-aee8-4ca6993a9769/konnectivity-agent/0.log"
Jul 23 18:44:02.584397 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:02.584373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-71.ec2.internal_ab09ee2af8333859f31ea014dc055c28/haproxy/0.log"
Jul 23 18:44:09.819829 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:09.819745    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b35c447-4c09-451e-89e0-1f167a3cfdb0/alertmanager/0.log"
Jul 23 18:44:09.845303 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:09.845266    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b35c447-4c09-451e-89e0-1f167a3cfdb0/config-reloader/0.log"
Jul 23 18:44:09.871794 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:09.871765    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b35c447-4c09-451e-89e0-1f167a3cfdb0/kube-rbac-proxy-web/0.log"
Jul 23 18:44:09.898832 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:09.898800    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b35c447-4c09-451e-89e0-1f167a3cfdb0/kube-rbac-proxy/0.log"
Jul 23 18:44:09.922834 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:09.922816    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b35c447-4c09-451e-89e0-1f167a3cfdb0/kube-rbac-proxy-metric/0.log"
Jul 23 18:44:09.953635 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:09.953612    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b35c447-4c09-451e-89e0-1f167a3cfdb0/prom-label-proxy/0.log"
Jul 23 18:44:09.994258 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:09.994238    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b35c447-4c09-451e-89e0-1f167a3cfdb0/init-config-reloader/0.log"
Jul 23 18:44:10.183806 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.183781    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c4b4b96d-qwjzv_5f1c5147-f49e-4cc3-a46e-03ab065e1613/metrics-server/0.log"
Jul 23 18:44:10.333765 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.333738    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m8876_8adccf88-550c-40f6-9d60-03fcd7c78f72/node-exporter/0.log"
Jul 23 18:44:10.358657 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.358636    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m8876_8adccf88-550c-40f6-9d60-03fcd7c78f72/kube-rbac-proxy/0.log"
Jul 23 18:44:10.381454 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.381432    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m8876_8adccf88-550c-40f6-9d60-03fcd7c78f72/init-textfile/0.log"
Jul 23 18:44:10.588264 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.588241    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ca259b-127b-43de-b1ba-16bbe33d77e3/prometheus/0.log"
Jul 23 18:44:10.616483 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.616465    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ca259b-127b-43de-b1ba-16bbe33d77e3/config-reloader/0.log"
Jul 23 18:44:10.647690 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.647646    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ca259b-127b-43de-b1ba-16bbe33d77e3/thanos-sidecar/0.log"
Jul 23 18:44:10.674783 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.674761    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ca259b-127b-43de-b1ba-16bbe33d77e3/kube-rbac-proxy-web/0.log"
Jul 23 18:44:10.699190 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.699171    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ca259b-127b-43de-b1ba-16bbe33d77e3/kube-rbac-proxy/0.log"
Jul 23 18:44:10.723946 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.723923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ca259b-127b-43de-b1ba-16bbe33d77e3/kube-rbac-proxy-thanos/0.log"
Jul 23 18:44:10.749526 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.749506    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ca259b-127b-43de-b1ba-16bbe33d77e3/init-config-reloader/0.log"
Jul 23 18:44:10.837836 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.837752    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-m7trk_49e81992-3b42-403a-9534-0622738eba12/prometheus-operator-admission-webhook/0.log"
Jul 23 18:44:10.868183 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.868161    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78ffb8fddf-drdl7_8d515dea-d929-4191-9b11-edd30656c496/telemeter-client/0.log"
Jul 23 18:44:10.893305 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.893287    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78ffb8fddf-drdl7_8d515dea-d929-4191-9b11-edd30656c496/reload/0.log"
Jul 23 18:44:10.919371 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:10.919352    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78ffb8fddf-drdl7_8d515dea-d929-4191-9b11-edd30656c496/kube-rbac-proxy/0.log"
Jul 23 18:44:11.771132 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.771098    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"]
Jul 23 18:44:11.771526 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.771510    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd8e58c-188c-47dc-b586-302e5627c4c6" containerName="maas-api"
Jul 23 18:44:11.771607 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.771527    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd8e58c-188c-47dc-b586-302e5627c4c6" containerName="maas-api"
Jul 23 18:44:11.771607 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.771546    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="887160a3-1eab-4d5b-8941-8d47b55cfff5" containerName="maas-api"
Jul 23 18:44:11.771607 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.771552    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="887160a3-1eab-4d5b-8941-8d47b55cfff5" containerName="maas-api"
Jul 23 18:44:11.771735 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.771610    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="887160a3-1eab-4d5b-8941-8d47b55cfff5" containerName="maas-api"
Jul 23 18:44:11.771735 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.771623    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bd8e58c-188c-47dc-b586-302e5627c4c6" containerName="maas-api"
Jul 23 18:44:11.774369 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.774354    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.778855 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.778834    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mgnx\"/\"kube-root-ca.crt\""
Jul 23 18:44:11.779371 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.779358    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mgnx\"/\"openshift-service-ca.crt\""
Jul 23 18:44:11.779445 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.779396    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2mgnx\"/\"default-dockercfg-vpwh6\""
Jul 23 18:44:11.786019 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.785994    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"]
Jul 23 18:44:11.884987 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.884960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-proc\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.885298 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.885011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-podres\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.885298 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.885064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2bjc\" (UniqueName: \"kubernetes.io/projected/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-kube-api-access-w2bjc\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.885298 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.885093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-lib-modules\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.885298 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.885112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-sys\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985692 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-proc\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985805 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-podres\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985805 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2bjc\" (UniqueName: \"kubernetes.io/projected/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-kube-api-access-w2bjc\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985805 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-proc\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985805 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-lib-modules\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985942 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-sys\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985942 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-lib-modules\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985942 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-sys\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.985942 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.985891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-podres\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:11.998983 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:11.998962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2bjc\" (UniqueName: \"kubernetes.io/projected/27a5c31f-6d9e-46ae-8bcc-4743b6e35729-kube-api-access-w2bjc\") pod \"perf-node-gather-daemonset-z588b\" (UID: \"27a5c31f-6d9e-46ae-8bcc-4743b6e35729\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:12.084306 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.084282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:12.218239 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.218215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"]
Jul 23 18:44:12.220482 ip-10-0-129-71 kubenswrapper[2560]: W0723 18:44:12.220453    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27a5c31f_6d9e_46ae_8bcc_4743b6e35729.slice/crio-2aee191743ec39c715737607119ab7b14dc777d8dc0b10ee8af27bf54de3b0cf WatchSource:0}: Error finding container 2aee191743ec39c715737607119ab7b14dc777d8dc0b10ee8af27bf54de3b0cf: Status 404 returned error can't find the container with id 2aee191743ec39c715737607119ab7b14dc777d8dc0b10ee8af27bf54de3b0cf
Jul 23 18:44:12.331019 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.330983    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b" event={"ID":"27a5c31f-6d9e-46ae-8bcc-4743b6e35729","Type":"ContainerStarted","Data":"992147dcf57bebf0fe670d32f6e9eefe5a52474e5291d3666766d84fbfc0bb34"}
Jul 23 18:44:12.331182 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.331059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b" event={"ID":"27a5c31f-6d9e-46ae-8bcc-4743b6e35729","Type":"ContainerStarted","Data":"2aee191743ec39c715737607119ab7b14dc777d8dc0b10ee8af27bf54de3b0cf"}
Jul 23 18:44:12.331182 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.331096    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:12.353395 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.353312    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b" podStartSLOduration=1.353298242 podStartE2EDuration="1.353298242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:12.351705415 +0000 UTC m=+2813.607182639" watchObservedRunningTime="2026-07-23 18:44:12.353298242 +0000 UTC m=+2813.608775467"
Jul 23 18:44:12.928464 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.928435    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/1.log"
Jul 23 18:44:12.932881 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:12.932861    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hstvn_fab3b010-3e1e-4332-a3bf-5c21a3c68a7c/console-operator/2.log"
Jul 23 18:44:13.460254 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:13.460228    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f8cb5fdc-ljvcz_6e7384e7-d747-43f8-977f-48a20500cfd1/console/0.log"
Jul 23 18:44:13.493348 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:13.493317    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-7fffl_67ab10ce-3a34-498c-aa88-5b6bc28a33ff/download-server/0.log"
Jul 23 18:44:15.215346 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:15.215321    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tdrn_b9c472ce-649d-461f-a266-3d130826682f/dns/0.log"
Jul 23 18:44:15.241808 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:15.241786    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tdrn_b9c472ce-649d-461f-a266-3d130826682f/kube-rbac-proxy/0.log"
Jul 23 18:44:15.322352 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:15.322329    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fg5p8_aa7f41bd-482d-4bd6-92c9-e2680f3d98a9/dns-node-resolver/0.log"
Jul 23 18:44:16.040260 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:16.040236    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pjfjn_4356b5d1-a41e-48d6-8337-a0fcd446e859/node-ca/0.log"
Jul 23 18:44:17.216507 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:17.216478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rnm2f_39ee8c73-bb31-4171-8f04-f0396ef02e4a/discovery/0.log"
Jul 23 18:44:17.403722 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:17.403698    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mvm4g_156b94bc-8345-49f2-a6c8-7e48725bbe31/payload-pre-processing/0.log"
Jul 23 18:44:17.435423 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:17.435400    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hwfn6_0f91ff38-3352-4dfb-b4b0-8f470c6db5a1/payload-processing/0.log"
Jul 23 18:44:18.271681 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:18.271657    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mz9qk_d2a5deb7-db60-4411-b869-163ef08ea9b0/serve-healthcheck-canary/0.log"
Jul 23 18:44:18.345539 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:18.345515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-z588b"
Jul 23 18:44:18.830033 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:18.830005    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hswxc_846c558b-787c-491f-b363-7b006b0471ba/kube-rbac-proxy/0.log"
Jul 23 18:44:18.853495 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:18.853471    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hswxc_846c558b-787c-491f-b363-7b006b0471ba/exporter/0.log"
Jul 23 18:44:18.878524 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:18.878497    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hswxc_846c558b-787c-491f-b363-7b006b0471ba/extractor/0.log"
Jul 23 18:44:22.014157 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:22.013742    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cf75b947b-l5dkd_25908a53-2ed8-4be1-9663-37ce13aada77/manager/0.log"
Jul 23 18:44:22.237926 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:22.237887    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-6ksjc_043a2e63-e15b-47f1-87b8-e25188e22ddb/manager/0.log"
Jul 23 18:44:22.259817 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:22.259793    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-6ksjc_043a2e63-e15b-47f1-87b8-e25188e22ddb/copy-manifests/0.log"
Jul 23 18:44:22.656369 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:22.656333    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rnm2f_39ee8c73-bb31-4171-8f04-f0396ef02e4a/discovery/0.log"
Jul 23 18:44:22.817575 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:22.817542    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mvm4g_156b94bc-8345-49f2-a6c8-7e48725bbe31/payload-pre-processing/0.log"
Jul 23 18:44:22.848245 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:22.848215    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hwfn6_0f91ff38-3352-4dfb-b4b0-8f470c6db5a1/payload-processing/0.log"
Jul 23 18:44:23.911024 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:23.910999    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56f479bbd7-knwr7_6d9b1939-475e-4ad0-b60c-6e0debda1729/manager/0.log"
Jul 23 18:44:24.267952 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:24.267917    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rnm2f_39ee8c73-bb31-4171-8f04-f0396ef02e4a/discovery/0.log"
Jul 23 18:44:24.391860 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:24.391830    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mvm4g_156b94bc-8345-49f2-a6c8-7e48725bbe31/payload-pre-processing/0.log"
Jul 23 18:44:24.420821 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:24.420795    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hwfn6_0f91ff38-3352-4dfb-b4b0-8f470c6db5a1/payload-processing/0.log"
Jul 23 18:44:28.890288 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:28.890261    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fgvrh_02f3d940-5847-4bbe-88f6-1894e8d1b475/migrator/0.log"
Jul 23 18:44:28.916632 ip-10-0-129-71 kubenswrapper[2560]: I0723 18:44:28.916606    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fgvrh_02f3d940-5847-4bbe-88f6-1894e8d1b475/graceful-termination/0.log"