Jul 30 22:38:14.793777 ip-10-0-137-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 22:38:14.793790 ip-10-0-137-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 22:38:14.793797 ip-10-0-137-134 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 22:38:14.794040 ip-10-0-137-134 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 22:38:26.193123 ip-10-0-137-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 22:38:26.193149 ip-10-0-137-134 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9d3faf804b934a3f8214ba3ea661bc3d --
Jul 30 22:40:02.796916 ip-10-0-137-134 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 22:40:03.267498 ip-10-0-137-134 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:40:03.267498 ip-10-0-137-134 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 22:40:03.267498 ip-10-0-137-134 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:40:03.267498 ip-10-0-137-134 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 22:40:03.267498 ip-10-0-137-134 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:40:03.270693 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.270495    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276355    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276376    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276381    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276385    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276389    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276392    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276395    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:03.276384 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276398    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276405    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276408    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276412    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276414    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276417    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276419    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276422    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276424    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276427    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276429    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276432    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276435    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276438    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276440    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276443    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276445    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276448    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276450    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:03.276701 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276452    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276455    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276458    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276460    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276463    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276466    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276468    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276471    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276473    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276476    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276479    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276481    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276485    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276488    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276491    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276494    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276496    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276499    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276501    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:03.277144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276506    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276510    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276513    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276515    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276518    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276520    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276523    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276525    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276527    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276530    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276532    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276535    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276537    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276539    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276542    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276544    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276546    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276549    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276551    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276553    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:03.277630 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276556    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276559    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276561    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276564    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276566    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276569    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276572    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276595    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276600    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276604    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276608    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276613    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276616    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276619    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276622    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276624    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276627    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276629    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276632    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276635    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:03.278152 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276637    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276640    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276642    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276647    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276651    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276654    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276657    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276660    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276663    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276666    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276670    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276673    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276676    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.276678    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277405    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277411    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277415    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277418    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277421    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277424    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:03.278662 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277427    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277429    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277432    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277435    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277437    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277442    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277446    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277449    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277452    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277455    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277459    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277464    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277467    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277470    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277473    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277476    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277480    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277483    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277485    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:03.279144 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277488    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277491    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277493    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277496    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277498    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277501    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277504    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277506    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277509    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277511    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277514    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277516    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277519    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277522    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277525    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277527    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277530    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277532    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277534    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277537    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:03.279621 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277539    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277543    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277545    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277547    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277550    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277552    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277555    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277557    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277559    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277562    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277565    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277568    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277570    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277601    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277605    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277609    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277611    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277614    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277617    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277619    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:03.280121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277622    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277624    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277627    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277630    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277634    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277638    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277642    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277645    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277648    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277651    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277654    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277656    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277659    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277661    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277664    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277666    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277668    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277671    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277674    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:03.280682 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277677    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277680    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277683    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277685    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277688    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277691    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277694    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277696    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277699    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277701    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277705    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277707    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277709    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277712    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.277714    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278160    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278166    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278170    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278173    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278177    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:03.281157 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278180    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278183    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278186    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278190    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278193    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278196    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278199    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278201    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278204    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278206    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278209    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278212    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278215    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278217    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278220    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278222    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278225    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278227    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278229    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278232    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:03.281677 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278235    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278237    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278240    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278242    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278244    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278247    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278249    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278252    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278254    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278257    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278260    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278262    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278266    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278268    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278271    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278274    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278276    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278280    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278283    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:03.282173 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278286    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278288    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278291    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278293    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278296    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278299    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278301    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278304    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278306    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278309    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278311    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278313    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278316    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278318    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278321    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278323    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278325    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278328    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278331    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278333    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:03.282713 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278336    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278338    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278341    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278343    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278346    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278348    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278352    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278355    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278357    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278359    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278363    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278366    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278370    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278372    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278375    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278377    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278380    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278383    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278386    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278388    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:03.283185 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278391    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278393    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278396    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278398    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278412    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278415    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278418    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278420    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278423    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278425    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278428    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278431    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278433    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278436    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.278438    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278515    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278523    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278530    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278537    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278544    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278550    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 22:40:03.283703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278556    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278563    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278567    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278570    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278587    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278591    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278594    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278598    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278601    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278604    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278606    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278609    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278613    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278616    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278620    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278623    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278626    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278630    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278633    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278636    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278639    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278642    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278645    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278648    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 22:40:03.284228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278652    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278655    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278660    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278662    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278665    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278668    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278671    2565 flags.go:64] FLAG: --enable-server="true"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278675    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278681    2565 flags.go:64] FLAG: --event-burst="100"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278684    2565 flags.go:64] FLAG: --event-qps="50"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278687    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278690    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278693    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278696    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278699    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278705    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278708    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278711    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278714    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278717    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278720    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278723    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278726    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278729    2565 flags.go:64] FLAG: --feature-gates=""
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278732    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 22:40:03.284830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278737    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278740    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278743    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278747    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278750    2565 flags.go:64] FLAG: --help="false"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278753    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278756    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278759    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278762    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278765    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278769    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278771    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278774    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278777    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278780    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278783    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278787    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278790    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278793    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278795    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278798    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278801    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278806    2565 flags.go:64] FLAG: --lock-file=""
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278809    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 22:40:03.285526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278811    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278815    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278820    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278823    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278826    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278828    2565 flags.go:64] FLAG: --logging-format="text"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278831    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278835    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278839    2565 flags.go:64] FLAG: --manifest-url=""
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278841    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278846    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278849    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278853    2565 flags.go:64] FLAG: --max-pods="110"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278856    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278859    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278862    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278865    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278867    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278871    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278874    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278881    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278884    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278887    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 22:40:03.286190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278890    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278894    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278900    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278903    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278906    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278909    2565 flags.go:64] FLAG: --port="10250"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278913    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278916    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0afef42e22b5dbc5d"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278922    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278925    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278928    2565 flags.go:64] FLAG: --register-node="true"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278932    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278936    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278938    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278941    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278944    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278948    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278952    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278955    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278958    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278961    2565 flags.go:64] FLAG: --runonce="false"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278964    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278967    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278970    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278973    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 22:40:03.286853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278975    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278979    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278982    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278985    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278988    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278991    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278994    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.278996    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279000    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279003    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279006    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279011    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279013    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279016    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279020    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279025    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279027    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279030    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279033    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279036    2565 flags.go:64] FLAG: --v="2"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279040    2565 flags.go:64] FLAG: --version="false"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279044    2565 flags.go:64] FLAG: --vmodule=""
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279048    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279051    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279179    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:03.287482 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279182    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279185    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279188    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279190    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279193    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279196    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279198    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279200    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279203    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279206    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279208    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279211    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279213    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279216    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279219    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279222    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279224    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279227    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279229    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279232    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:03.288128 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279235    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279237    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279241    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279244    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279246    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279249    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279252    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279254    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279257    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279260    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279262    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279266    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279269    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279271    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279274    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279277    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279279    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279282    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279284    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:03.288648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279287    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279289    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279292    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279294    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279297    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279300    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279302    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279305    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279309    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279312    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279315    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279318    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279321    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279323    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279326    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279330    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279333    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279336    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279338    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279341    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:03.289121 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279343    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279346    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279350    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279353    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279357    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279360    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279363    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279366    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279369    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279372    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279374    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279377    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279379    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279382    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279384    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279387    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279389    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279392    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279394    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:03.289689 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279397    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279399    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279403    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279407    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279410    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279413    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279416    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279418    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279422    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279425    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279427    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279430    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279432    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279434    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279437    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279439    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279441    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279449    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279452    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:03.290164 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.279454    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.279460    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.286559    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.286592    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.286612    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.286622    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286683    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286688    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286691    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286694    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286697    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286700    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286704    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286707    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286709    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:03.290945 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286712    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286715    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286718    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286721    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286723    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286726    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286729    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286731    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286734    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286736    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286739    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286742    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286745    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286748    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286750    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286753    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286755    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286758    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286760    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286763    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:03.291398 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286767    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286770    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286772    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286775    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286778    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286780    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286783    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286785    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286788    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286790    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286793    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286795    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286799    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286801    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286804    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286807    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286809    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286812    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286814    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286817    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:03.291977 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286819    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286821    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286824    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286827    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286831    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286835    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286838    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286841    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286844    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286848    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286851    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286854    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286857    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286861    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286865    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286868    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286871    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286874    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286877    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286880    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:03.292465 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286882    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286885    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286887    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286890    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286892    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286895    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286897    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286899    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286902    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286905    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286907    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286910    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286912    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286915    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286917    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286922    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286926    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286929    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286932    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:03.292991 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286935    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286937    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286940    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286942    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286945    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286948    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286951    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286955    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286958    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286961    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.286963    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.286969    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287091    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287096    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:03.293464 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287098    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287101    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287104    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287107    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287110    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287113    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287115    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287118    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287120    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287123    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287125    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287128    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287131    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287134    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287137    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287139    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287142    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287145    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287149    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287153    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:03.293837 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287155    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287158    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287160    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287163    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287166    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287169    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287172    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287174    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287178    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287181    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287184    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287187    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287190    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287192    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287195    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287198    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287200    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287203    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287206    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:03.294335 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287209    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287211    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287214    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287217    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287219    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287222    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287225    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287228    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287230    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287233    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287236    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287238    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287241    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287243    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287246    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287248    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287251    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287254    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287257    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287260    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:03.294847 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287262    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287265    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287267    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287270    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287273    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287275    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287277    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287280    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287282    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287285    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287287    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287290    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287292    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287295    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287297    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287300    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287302    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287305    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287307    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287310    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:03.295334 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287312    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287315    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287317    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287320    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287322    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287325    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287327    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287330    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287332    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287335    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287339    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287342    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287344    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287348    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287350    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287353    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287356    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:03.295841 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:03.287358    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:03.296279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.287363    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:40:03.296279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.287497    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 22:40:03.296279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.289794    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 22:40:03.296279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.291645    2565 server.go:1019] "Starting client certificate rotation"
Jul 30 22:40:03.296279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.291709    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 22:40:03.296279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.291905    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 22:40:03.296279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.294478    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 22:40:03.296470 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.296452    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 22:40:03.308991 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.308964    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 30 22:40:03.311432 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.311411    2565 log.go:25] "Validated CRI v1 image API"
Jul 30 22:40:03.312350 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.312328    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 22:40:03.315528 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.315506    2565 fs.go:135] Filesystem UUIDs: map[1eb6e34f-57ac-4594-b118-7e8501ee32ed:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 de27faaf-56cc-41b1-ab78-8ae2ee436959:/dev/nvme0n1p3]
Jul 30 22:40:03.315630 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.315526    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 22:40:03.320605 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.320457    2565 manager.go:216] Machine: {Timestamp:2026-07-30 22:40:03.319946084 +0000 UTC m=+0.381407470 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101925 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec251ea7a1d13dfccb9e05a77ca6cb22 SystemUUID:ec251ea7-a1d1-3dfc-cb9e-05a77ca6cb22 BootID:9d3faf80-4b93-4a3f-8214-ba3ea661bc3d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e3:10:b5:75:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e3:10:b5:75:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:64:6d:1d:e8:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 22:40:03.320605 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.320569    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 22:40:03.320779 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.320679    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 22:40:03.321170 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.321153    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 22:40:03.324175 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.324139    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 22:40:03.324377 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.324187    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 22:40:03.325084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.325073    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 22:40:03.325117 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.325086    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 22:40:03.325117 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.325094    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 22:40:03.325732 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.325721    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 22:40:03.326901 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.326888    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 22:40:03.330978 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.330961    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 22:40:03.331118 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331109    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 22:40:03.331157 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331144    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 22:40:03.331185 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331159    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 22:40:03.331213 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331185    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 22:40:03.331213 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331200    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 30 22:40:03.331213 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331212    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 22:40:03.331789 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331773    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 22:40:03.331789 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.331793    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 22:40:03.336332 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.336309    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 22:40:03.338096 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.338082    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 22:40:03.338143 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.338113    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 22:40:03.339405 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339391    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339409    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339416    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339422    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339430    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339437    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339445    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339449    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339457    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339462    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339470    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339476    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 22:40:03.339495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339500    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 22:40:03.339967 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.339505    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 22:40:03.342224 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.342203    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 22:40:03.342335 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.342302    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 22:40:03.342481 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.342456    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 22:40:03.343112 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.343099    2565 server.go:1268] "Started kubelet"
Jul 30 22:40:03.343223 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.343187    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 22:40:03.343271 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.343211    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 22:40:03.343318 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.343287    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 22:40:03.344116 ip-10-0-137-134 systemd[1]: Started Kubernetes Kubelet.
Jul 30 22:40:03.345308 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.345290    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 22:40:03.347823 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.347800    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 22:40:03.349961 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.349935    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 22:40:03.351239 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.350165    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-134.ec2.internal.18c73268e30ea317  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-134.ec2.internal,UID:ip-10-0-137-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-134.ec2.internal,},FirstTimestamp:2026-07-30 22:40:03.343065879 +0000 UTC m=+0.404527266,LastTimestamp:2026-07-30 22:40:03.343065879 +0000 UTC m=+0.404527266,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-134.ec2.internal,}"
Jul 30 22:40:03.354234 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.354220    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 22:40:03.354234 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.354226    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 22:40:03.354425 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.354392    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:03.355055 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355038    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 22:40:03.355149 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355060    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 22:40:03.355149 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355039    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 22:40:03.355282 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355267    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 22:40:03.355282 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355282    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 22:40:03.355725 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355707    2565 factory.go:153] Registering CRI-O factory
Jul 30 22:40:03.355725 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355728    2565 factory.go:223] Registration of the crio container factory successfully
Jul 30 22:40:03.355854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355781    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 22:40:03.355854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355807    2565 factory.go:55] Registering systemd factory
Jul 30 22:40:03.355854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355816    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 30 22:40:03.355854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355838    2565 factory.go:103] Registering Raw factory
Jul 30 22:40:03.355854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.355855    2565 manager.go:1196] Started watching for new ooms in manager
Jul 30 22:40:03.356526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.356499    2565 manager.go:349] Starting recovery of all containers
Jul 30 22:40:03.358143 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.358113    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 22:40:03.362747 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.362715    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 22:40:03.366869 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.366829    2565 manager.go:354] Recovery completed
Jul 30 22:40:03.369700 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.369496    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpz7j"
Jul 30 22:40:03.369700 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.369666    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 30 22:40:03.373067 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.373054    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:03.374947 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.374930    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:03.375014 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.374964    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:03.375014 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.374979    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:03.375541 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.375526    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 22:40:03.375541 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.375537    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:03.375625 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.375540    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 22:40:03.375625 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.375568    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 22:40:03.376213 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.376196    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:03.376262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.376225    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:03.376262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.376234    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:03.376903 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.376886    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpz7j"
Jul 30 22:40:03.376966 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.376946    2565 policy_none.go:49] "None policy: Start"
Jul 30 22:40:03.376966 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.376964    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 22:40:03.377059 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.376986    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 22:40:03.377206 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.377137    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-134.ec2.internal.18c73268e4f51e06  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-134.ec2.internal,UID:ip-10-0-137-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-134.ec2.internal,},FirstTimestamp:2026-07-30 22:40:03.374947846 +0000 UTC m=+0.436409233,LastTimestamp:2026-07-30 22:40:03.374947846 +0000 UTC m=+0.436409233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-134.ec2.internal,}"
Jul 30 22:40:03.378956 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.378942    2565 policy_none.go:47] "Start"
Jul 30 22:40:03.417565 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.417541    2565 manager.go:337] "Starting Device Plugin manager"
Jul 30 22:40:03.417861 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.417604    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 22:40:03.417861 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.417620    2565 server.go:87] "Starting device plugin registration server"
Jul 30 22:40:03.418031 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.417959    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 22:40:03.418031 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.417975    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 22:40:03.418380 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.418121    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 22:40:03.418380 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.418198    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 22:40:03.418380 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.418208    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 22:40:03.418884 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.418866    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 22:40:03.418977 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.418909    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:03.461481 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.461444    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 22:40:03.462841 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.462822    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 22:40:03.462906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.462862    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 22:40:03.462906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.462889    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 22:40:03.462985 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.462923    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 22:40:03.465662 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.465636    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:03.518768 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.518668    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:03.520083 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.520065    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:03.520167 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.520099    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:03.520167 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.520109    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:03.520167 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.520133    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.528404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.528385    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.528467 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.528415    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-134.ec2.internal\": node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:03.549676 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.549648    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:03.563035 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.563002    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"]
Jul 30 22:40:03.563102 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.563082    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:03.564832 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.564814    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:03.564918 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.564845    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:03.564918 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.564867    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:03.566046 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566029    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:03.566168 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.566209 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566183    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:03.566881 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566866    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:03.566954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566891    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:03.566954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566901    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:03.566954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566869    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:03.566954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566953    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:03.567073 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.566965    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:03.567960 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.567942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.568032 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.567973    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:03.568813 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.568794    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:03.568894 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.568823    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:03.568894 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.568833    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:03.590306 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.590278    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-134.ec2.internal\" not found" node="ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.595021 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.594999    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-134.ec2.internal\" not found" node="ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.649877 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.649847    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:03.657259 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.657229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/883f0f6eccee17e7b34cc6fea681db6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"883f0f6eccee17e7b34cc6fea681db6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.657333 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.657268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/883f0f6eccee17e7b34cc6fea681db6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"883f0f6eccee17e7b34cc6fea681db6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.657333 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.657286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/518fa4cb778829bfdb295bed0f31592e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-134.ec2.internal\" (UID: \"518fa4cb778829bfdb295bed0f31592e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.750436 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.750376    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:03.757820 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.757797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/883f0f6eccee17e7b34cc6fea681db6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"883f0f6eccee17e7b34cc6fea681db6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.757871 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.757842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/883f0f6eccee17e7b34cc6fea681db6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"883f0f6eccee17e7b34cc6fea681db6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.757871 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.757863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/518fa4cb778829bfdb295bed0f31592e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-134.ec2.internal\" (UID: \"518fa4cb778829bfdb295bed0f31592e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.757926 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.757896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/883f0f6eccee17e7b34cc6fea681db6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"883f0f6eccee17e7b34cc6fea681db6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.757954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.757904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/883f0f6eccee17e7b34cc6fea681db6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal\" (UID: \"883f0f6eccee17e7b34cc6fea681db6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.757997 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.757967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/518fa4cb778829bfdb295bed0f31592e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-134.ec2.internal\" (UID: \"518fa4cb778829bfdb295bed0f31592e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.851261 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.851173    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:03.893683 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.893655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.898036 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:03.898012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:03.952261 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:03.952217    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:04.052797 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.052755    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:04.153399 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.153309    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-134.ec2.internal\" not found"
Jul 30 22:40:04.184207 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.184178    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:04.254459 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.254419    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:04.266842 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.266811    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 22:40:04.268237 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.268222    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal"
Jul 30 22:40:04.273807 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.273791    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 22:40:04.291985 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.291957    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 22:40:04.292157 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.292131    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 22:40:04.332112 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.332071    2565 apiserver.go:52] "Watching apiserver"
Jul 30 22:40:04.340059 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.340029    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 22:40:04.340407 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.340386    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r","openshift-cluster-node-tuning-operator/tuned-tmhdj","openshift-image-registry/node-ca-mwcds","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal","openshift-multus/multus-additional-cni-plugins-kg4kh","openshift-multus/multus-jznvw","openshift-network-diagnostics/network-check-target-t7t4k","openshift-network-operator/iptables-alerter-hx64f","kube-system/global-pull-secret-syncer-69zk4","kube-system/konnectivity-agent-8vtq5","kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal","openshift-dns/node-resolver-d5c5m","openshift-multus/network-metrics-daemon-rfbsc","openshift-ovn-kubernetes/ovnkube-node-j4zlm"]
Jul 30 22:40:04.342568 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.342367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.344725 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.344656    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.344905 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.344871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.345711 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.345675    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 22:40:04.345812 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.345723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 22:40:04.345812 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.345754    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zhwpj\""
Jul 30 22:40:04.346062 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.346034    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 22:40:04.346862 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.346824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:04.346986 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.346963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:04.347187 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.347164    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wxtbt\""
Jul 30 22:40:04.347294 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.347276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 22:40:04.347354 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.347314    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2hkk\""
Jul 30 22:40:04.347354 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.347336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 22:40:04.347516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.347502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.348407 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.348391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.349690 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.349672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:04.349816 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.349791    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:04.350795 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.350775    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 22:40:04.351037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.351022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.351856 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.351838    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 22:40:04.351856 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.351854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 22:40:04.352055 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.352031    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 22:40:04.352119 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.352104    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f666g\""
Jul 30 22:40:04.352189 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.352173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.352297 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.352244    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:04.352332 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.352320    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 22:40:04.352372 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.352359    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 22:40:04.352471 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.352450    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 22:40:04.352604 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.352591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r784g\""
Jul 30 22:40:04.353197 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.353182    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b9l5j\""
Jul 30 22:40:04.353268 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.353244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:04.353332 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.353294    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:04.353483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.353469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.353644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.353629    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 22:40:04.354342 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.354326    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 22:40:04.354826 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.354809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.355522 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.355506    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 22:40:04.355765 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.355739    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dg88w\""
Jul 30 22:40:04.355877 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.355867    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 22:40:04.356094 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.356078    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:04.356181 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.356150    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:04.357054 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.357036    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 22:40:04.357548 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.357533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.358004 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.357988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f6dsl\""
Jul 30 22:40:04.358295 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.358280    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 22:40:04.359765 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.359749    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 22:40:04.359853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.359791    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 22:40:04.359853 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.359821    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 22:40:04.360143 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.360128    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lcqg4\""
Jul 30 22:40:04.360234 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.360162    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 22:40:04.360277 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.360251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 22:40:04.360309 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.360289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 22:40:04.361116 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-modprobe-d\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361166 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-host\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361166 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-tuned\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361166 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-run\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361311 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf54s\" (UniqueName: \"kubernetes.io/projected/4096f4c0-18c1-414f-ba76-8a3e0620276f-kube-api-access-cf54s\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.361311 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-conf-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.361311 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-daemon-config\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.361311 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-hostroot\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361336    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51b906bc-8445-4b46-9236-9d66b897c705-hosts-file\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-device-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysconfig\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-sys\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-netns\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-registration-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.361472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92ft2\" (UniqueName: \"kubernetes.io/projected/8379cc47-c521-4660-9c0d-a40f4e63ea13-kube-api-access-92ft2\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4096f4c0-18c1-414f-ba76-8a3e0620276f-cni-binary-copy\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e63f9ed-05f2-4b20-8952-71b930abe223-agent-certs\") pod \"konnectivity-agent-8vtq5\" (UID: \"6e63f9ed-05f2-4b20-8952-71b930abe223\") " pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf65f\" (UniqueName: \"kubernetes.io/projected/51b906bc-8445-4b46-9236-9d66b897c705-kube-api-access-kf65f\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-sys-fs\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-lib-modules\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def3da5d-7c3b-42d9-8342-fb48afcecb4e-tmp\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sst65\" (UniqueName: \"kubernetes.io/projected/66db1610-68b5-4de1-a3b3-89c9da98924c-kube-api-access-sst65\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zr75\" (UniqueName: \"kubernetes.io/projected/def3da5d-7c3b-42d9-8342-fb48afcecb4e-kube-api-access-5zr75\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8379cc47-c521-4660-9c0d-a40f4e63ea13-serviceca\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkfnc\" (UniqueName: \"kubernetes.io/projected/32b3fce6-25a2-40da-a249-56a8a68ec276-kube-api-access-bkfnc\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:04.361754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-socket-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-etc-selinux\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-system-cni-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-cni-multus\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf4hs\" (UniqueName: \"kubernetes.io/projected/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-kube-api-access-wf4hs\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-var-lib-kubelet\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b906bc-8445-4b46-9236-9d66b897c705-tmp-dir\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-socket-dir-parent\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-kubelet-config\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-dbus\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.361992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66db1610-68b5-4de1-a3b3-89c9da98924c-iptables-alerter-script\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-cnibin\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-os-release\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66db1610-68b5-4de1-a3b3-89c9da98924c-host-slash\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.362084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grvnc\" (UniqueName: \"kubernetes.io/projected/f046a693-f7fb-4768-9f0b-2ab613660a9f-kube-api-access-grvnc\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-cni-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-os-release\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-k8s-cni-cncf-io\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-multus-certs\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-cnibin\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-kubelet\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e63f9ed-05f2-4b20-8952-71b930abe223-konnectivity-ca\") pod \"konnectivity-agent-8vtq5\" (UID: \"6e63f9ed-05f2-4b20-8952-71b930abe223\") " pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-kubernetes\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysctl-d\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-etc-kubernetes\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.362701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysctl-conf\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.363200 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-systemd\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.363200 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-cni-bin\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.363200 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.362523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8379cc47-c521-4660-9c0d-a40f4e63ea13-host\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.370712 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.370689    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 22:40:04.381957 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.381904    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 22:35:04 +0000 UTC" deadline="2028-03-16 20:34:04.245860582 +0000 UTC"
Jul 30 22:40:04.381957 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.381947    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14277h53m59.863917041s"
Jul 30 22:40:04.393047 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.393020    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f4j2m"
Jul 30 22:40:04.400861 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.400834    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f4j2m"
Jul 30 22:40:04.455757 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.455738    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 22:40:04.463725 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-etc-kubernetes\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.463725 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysctl-conf\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-systemd\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-cni-netd\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-etc-kubernetes\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-cni-bin\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-systemd\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8379cc47-c521-4660-9c0d-a40f4e63ea13-host\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-cni-bin\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-etc-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-node-log\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.463913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysctl-conf\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8379cc47-c521-4660-9c0d-a40f4e63ea13-host\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovnkube-script-lib\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-modprobe-d\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.463976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-host\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-tuned\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-run\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-host\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf54s\" (UniqueName: \"kubernetes.io/projected/4096f4c0-18c1-414f-ba76-8a3e0620276f-kube-api-access-cf54s\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-conf-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-modprobe-d\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-run\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-daemon-config\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-hostroot\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51b906bc-8445-4b46-9236-9d66b897c705-hosts-file\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-device-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysconfig\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.464404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-hostroot\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-conf-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464304    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-device-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51b906bc-8445-4b46-9236-9d66b897c705-hosts-file\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysconfig\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-sys\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-run-netns\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-sys\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-cni-bin\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-netns\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-registration-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464424    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.464470    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-netns\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.464546    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret podName:8919e466-cff0-4c4f-b85d-b98ca5f4bbe1 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:04.964528529 +0000 UTC m=+2.025989905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret") pod "global-pull-secret-syncer-69zk4" (UID: "8919e466-cff0-4c4f-b85d-b98ca5f4bbe1") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-registration-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.465335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92ft2\" (UniqueName: \"kubernetes.io/projected/8379cc47-c521-4660-9c0d-a40f4e63ea13-kube-api-access-92ft2\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-log-socket\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4096f4c0-18c1-414f-ba76-8a3e0620276f-cni-binary-copy\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e63f9ed-05f2-4b20-8952-71b930abe223-agent-certs\") pod \"konnectivity-agent-8vtq5\" (UID: \"6e63f9ed-05f2-4b20-8952-71b930abe223\") " pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf65f\" (UniqueName: \"kubernetes.io/projected/51b906bc-8445-4b46-9236-9d66b897c705-kube-api-access-kf65f\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-sys-fs\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-lib-modules\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-daemon-config\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-sys-fs\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def3da5d-7c3b-42d9-8342-fb48afcecb4e-tmp\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sst65\" (UniqueName: \"kubernetes.io/projected/66db1610-68b5-4de1-a3b3-89c9da98924c-kube-api-access-sst65\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-lib-modules\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.464972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zr75\" (UniqueName: \"kubernetes.io/projected/def3da5d-7c3b-42d9-8342-fb48afcecb4e-kube-api-access-5zr75\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8379cc47-c521-4660-9c0d-a40f4e63ea13-serviceca\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkfnc\" (UniqueName: \"kubernetes.io/projected/32b3fce6-25a2-40da-a249-56a8a68ec276-kube-api-access-bkfnc\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9md66\" (UniqueName: \"kubernetes.io/projected/ba923054-f26a-4130-a790-c0f19e2cfcf3-kube-api-access-9md66\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.466361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-socket-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-etc-selinux\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-system-cni-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-cni-multus\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf4hs\" (UniqueName: \"kubernetes.io/projected/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-kube-api-access-wf4hs\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-var-lib-kubelet\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-kubelet\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-systemd-units\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b906bc-8445-4b46-9236-9d66b897c705-tmp-dir\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-socket-dir-parent\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-kubelet-config\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-dbus\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4096f4c0-18c1-414f-ba76-8a3e0620276f-cni-binary-copy\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66db1610-68b5-4de1-a3b3-89c9da98924c-iptables-alerter-script\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.467225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-slash\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-cnibin\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-os-release\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66db1610-68b5-4de1-a3b3-89c9da98924c-host-slash\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-var-lib-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-ovn\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovnkube-config\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grvnc\" (UniqueName: \"kubernetes.io/projected/f046a693-f7fb-4768-9f0b-2ab613660a9f-kube-api-access-grvnc\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-env-overrides\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-cni-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-os-release\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-k8s-cni-cncf-io\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.465995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-socket-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-multus-certs\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468098 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-cnibin\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-kubelet\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e63f9ed-05f2-4b20-8952-71b930abe223-konnectivity-ca\") pod \"konnectivity-agent-8vtq5\" (UID: \"6e63f9ed-05f2-4b20-8952-71b930abe223\") " pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-system-cni-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8379cc47-c521-4660-9c0d-a40f4e63ea13-serviceca\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-kubernetes\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysctl-d\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-kubernetes\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-systemd\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-cni-multus\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovn-node-metrics-cert\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-sysctl-d\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-multus-certs\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.468902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-cnibin\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-var-lib-kubelet\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def3da5d-7c3b-42d9-8342-fb48afcecb4e-var-lib-kubelet\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.466741    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.466795    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs podName:32b3fce6-25a2-40da-a249-56a8a68ec276 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:04.966777154 +0000 UTC m=+2.028238532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs") pod "network-metrics-daemon-rfbsc" (UID: "32b3fce6-25a2-40da-a249-56a8a68ec276") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-cnibin\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.466963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-os-release\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66db1610-68b5-4de1-a3b3-89c9da98924c-host-slash\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e63f9ed-05f2-4b20-8952-71b930abe223-konnectivity-ca\") pod \"konnectivity-agent-8vtq5\" (UID: \"6e63f9ed-05f2-4b20-8952-71b930abe223\") " pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-socket-dir-parent\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-kubelet-config\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-dbus\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f046a693-f7fb-4768-9f0b-2ab613660a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-etc-selinux\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-os-release\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-multus-cni-dir\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.469465 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.467876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4096f4c0-18c1-414f-ba76-8a3e0620276f-host-run-k8s-cni-cncf-io\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.470060 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.468264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b906bc-8445-4b46-9236-9d66b897c705-tmp-dir\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.470060 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.468491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f046a693-f7fb-4768-9f0b-2ab613660a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.470060 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.468552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66db1610-68b5-4de1-a3b3-89c9da98924c-iptables-alerter-script\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.470060 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.468637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/def3da5d-7c3b-42d9-8342-fb48afcecb4e-etc-tuned\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.470060 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.468711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def3da5d-7c3b-42d9-8342-fb48afcecb4e-tmp\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.470060 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.468957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e63f9ed-05f2-4b20-8952-71b930abe223-agent-certs\") pod \"konnectivity-agent-8vtq5\" (UID: \"6e63f9ed-05f2-4b20-8952-71b930abe223\") " pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.477793 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.477314    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:04.477793 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.477350    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:04.477793 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.477366    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8zmgc for pod openshift-network-diagnostics/network-check-target-t7t4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:04.477793 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.477506    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc podName:904a8475-32f4-4b6c-b752-2313b576ef64 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:04.977479973 +0000 UTC m=+2.038941371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8zmgc" (UniqueName: "kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc") pod "network-check-target-t7t4k" (UID: "904a8475-32f4-4b6c-b752-2313b576ef64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:04.481040 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.480236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sst65\" (UniqueName: \"kubernetes.io/projected/66db1610-68b5-4de1-a3b3-89c9da98924c-kube-api-access-sst65\") pod \"iptables-alerter-hx64f\" (UID: \"66db1610-68b5-4de1-a3b3-89c9da98924c\") " pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.481040 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.480564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf54s\" (UniqueName: \"kubernetes.io/projected/4096f4c0-18c1-414f-ba76-8a3e0620276f-kube-api-access-cf54s\") pod \"multus-jznvw\" (UID: \"4096f4c0-18c1-414f-ba76-8a3e0620276f\") " pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.481040 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.480815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf4hs\" (UniqueName: \"kubernetes.io/projected/9f5dbc92-ab67-4d0f-9e64-5acb993d4e86-kube-api-access-wf4hs\") pod \"aws-ebs-csi-driver-node-2t79r\" (UID: \"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.481040 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.480836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkfnc\" (UniqueName: \"kubernetes.io/projected/32b3fce6-25a2-40da-a249-56a8a68ec276-kube-api-access-bkfnc\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:04.481040 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.480989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92ft2\" (UniqueName: \"kubernetes.io/projected/8379cc47-c521-4660-9c0d-a40f4e63ea13-kube-api-access-92ft2\") pod \"node-ca-mwcds\" (UID: \"8379cc47-c521-4660-9c0d-a40f4e63ea13\") " pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.481398 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.481325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grvnc\" (UniqueName: \"kubernetes.io/projected/f046a693-f7fb-4768-9f0b-2ab613660a9f-kube-api-access-grvnc\") pod \"multus-additional-cni-plugins-kg4kh\" (UID: \"f046a693-f7fb-4768-9f0b-2ab613660a9f\") " pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.481553 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.481531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zr75\" (UniqueName: \"kubernetes.io/projected/def3da5d-7c3b-42d9-8342-fb48afcecb4e-kube-api-access-5zr75\") pod \"tuned-tmhdj\" (UID: \"def3da5d-7c3b-42d9-8342-fb48afcecb4e\") " pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.481611 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.481559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf65f\" (UniqueName: \"kubernetes.io/projected/51b906bc-8445-4b46-9236-9d66b897c705-kube-api-access-kf65f\") pod \"node-resolver-d5c5m\" (UID: \"51b906bc-8445-4b46-9236-9d66b897c705\") " pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.495844 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.495819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:04.510979 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.510954    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5c5m"
Jul 30 22:40:04.567782 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-systemd\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.567896 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovn-node-metrics-cert\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.567896 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.567896 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-systemd\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-cni-netd\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-etc-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-cni-netd\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-node-log\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-etc-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.567983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovnkube-script-lib\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568037 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-run-netns\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-cni-bin\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-node-log\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-log-socket\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-run-netns\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9md66\" (UniqueName: \"kubernetes.io/projected/ba923054-f26a-4130-a790-c0f19e2cfcf3-kube-api-access-9md66\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-log-socket\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-cni-bin\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-kubelet\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-kubelet\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-systemd-units\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovnkube-script-lib\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-systemd-units\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-slash\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-var-lib-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-ovn\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovnkube-config\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-host-slash\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-env-overrides\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-var-lib-openvswitch\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.568836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.568795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba923054-f26a-4130-a790-c0f19e2cfcf3-run-ovn\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.569312 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.569226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-env-overrides\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.569312 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.569271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovnkube-config\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.571354 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.571327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba923054-f26a-4130-a790-c0f19e2cfcf3-ovn-node-metrics-cert\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.571540 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.571515    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518fa4cb778829bfdb295bed0f31592e.slice/crio-4b401c458bc8dbd934f39a8804350e7cd03bad8203419dcb019e5dc8f170f62b WatchSource:0}: Error finding container 4b401c458bc8dbd934f39a8804350e7cd03bad8203419dcb019e5dc8f170f62b: Status 404 returned error can't find the container with id 4b401c458bc8dbd934f39a8804350e7cd03bad8203419dcb019e5dc8f170f62b
Jul 30 22:40:04.572082 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.572055    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883f0f6eccee17e7b34cc6fea681db6a.slice/crio-83ce261d01484bf69490ca8f14f7c5aaa11bddb59707456bf09f6c8882766ada WatchSource:0}: Error finding container 83ce261d01484bf69490ca8f14f7c5aaa11bddb59707456bf09f6c8882766ada: Status 404 returned error can't find the container with id 83ce261d01484bf69490ca8f14f7c5aaa11bddb59707456bf09f6c8882766ada
Jul 30 22:40:04.576793 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.576776    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:40:04.579851 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.579830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9md66\" (UniqueName: \"kubernetes.io/projected/ba923054-f26a-4130-a790-c0f19e2cfcf3-kube-api-access-9md66\") pod \"ovnkube-node-j4zlm\" (UID: \"ba923054-f26a-4130-a790-c0f19e2cfcf3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.672251 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.672154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r"
Jul 30 22:40:04.683707 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.683679    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f5dbc92_ab67_4d0f_9e64_5acb993d4e86.slice/crio-058f814d1089294ea9c66a0ce9bda5d1beff297c34da320bfcc111cb61795296 WatchSource:0}: Error finding container 058f814d1089294ea9c66a0ce9bda5d1beff297c34da320bfcc111cb61795296: Status 404 returned error can't find the container with id 058f814d1089294ea9c66a0ce9bda5d1beff297c34da320bfcc111cb61795296
Jul 30 22:40:04.685953 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.685935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mwcds"
Jul 30 22:40:04.696061 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.696031    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8379cc47_c521_4660_9c0d_a40f4e63ea13.slice/crio-5575df97204336d1c6e4714378e57026cea36c8054393882d7da4e8f8a06c354 WatchSource:0}: Error finding container 5575df97204336d1c6e4714378e57026cea36c8054393882d7da4e8f8a06c354: Status 404 returned error can't find the container with id 5575df97204336d1c6e4714378e57026cea36c8054393882d7da4e8f8a06c354
Jul 30 22:40:04.708048 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.708023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tmhdj"
Jul 30 22:40:04.718665 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.718623    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef3da5d_7c3b_42d9_8342_fb48afcecb4e.slice/crio-a7ce8a8daa9fbafaedaa7d4cbcdc99bda3b1e8bda24531843add23c1fc19eb44 WatchSource:0}: Error finding container a7ce8a8daa9fbafaedaa7d4cbcdc99bda3b1e8bda24531843add23c1fc19eb44: Status 404 returned error can't find the container with id a7ce8a8daa9fbafaedaa7d4cbcdc99bda3b1e8bda24531843add23c1fc19eb44
Jul 30 22:40:04.729665 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.729620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg4kh"
Jul 30 22:40:04.735117 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.735081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jznvw"
Jul 30 22:40:04.739943 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.739910    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf046a693_f7fb_4768_9f0b_2ab613660a9f.slice/crio-4648d1b228fa3edacef1e09259d361101fff8d9b01312e55828d9ce674033390 WatchSource:0}: Error finding container 4648d1b228fa3edacef1e09259d361101fff8d9b01312e55828d9ce674033390: Status 404 returned error can't find the container with id 4648d1b228fa3edacef1e09259d361101fff8d9b01312e55828d9ce674033390
Jul 30 22:40:04.744954 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.744929    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4096f4c0_18c1_414f_ba76_8a3e0620276f.slice/crio-d4b693cad5c4d46440921c77edc2dd5d79527c61a29d4524cba03474945e3d7b WatchSource:0}: Error finding container d4b693cad5c4d46440921c77edc2dd5d79527c61a29d4524cba03474945e3d7b: Status 404 returned error can't find the container with id d4b693cad5c4d46440921c77edc2dd5d79527c61a29d4524cba03474945e3d7b
Jul 30 22:40:04.770353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.770317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hx64f"
Jul 30 22:40:04.781758 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.781718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66db1610_68b5_4de1_a3b3_89c9da98924c.slice/crio-acbc8cccb3b4629d94f57a1ce93609ea287e5c83681e47d38fa64a00f825fbc3 WatchSource:0}: Error finding container acbc8cccb3b4629d94f57a1ce93609ea287e5c83681e47d38fa64a00f825fbc3: Status 404 returned error can't find the container with id acbc8cccb3b4629d94f57a1ce93609ea287e5c83681e47d38fa64a00f825fbc3
Jul 30 22:40:04.786621 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.786600    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:04.820006 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.819966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:04.829866 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.829828    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba923054_f26a_4130_a790_c0f19e2cfcf3.slice/crio-ddbfc4979842d52753d89896ff3a5a68d2c6a677fd1400f03b63bc06eff53fa8 WatchSource:0}: Error finding container ddbfc4979842d52753d89896ff3a5a68d2c6a677fd1400f03b63bc06eff53fa8: Status 404 returned error can't find the container with id ddbfc4979842d52753d89896ff3a5a68d2c6a677fd1400f03b63bc06eff53fa8
Jul 30 22:40:04.853043 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.853008    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:04.879551 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:04.879513    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e63f9ed_05f2_4b20_8952_71b930abe223.slice/crio-7e621a2c7a13f8c5763f230e8736367f48aa49c741de95ff5a720a03386c0703 WatchSource:0}: Error finding container 7e621a2c7a13f8c5763f230e8736367f48aa49c741de95ff5a720a03386c0703: Status 404 returned error can't find the container with id 7e621a2c7a13f8c5763f230e8736367f48aa49c741de95ff5a720a03386c0703
Jul 30 22:40:04.971495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.971394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:04.971495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:04.971444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:04.971737 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.971560    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:04.971737 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.971560    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:04.971737 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.971645    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs podName:32b3fce6-25a2-40da-a249-56a8a68ec276 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:05.971624646 +0000 UTC m=+3.033086047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs") pod "network-metrics-daemon-rfbsc" (UID: "32b3fce6-25a2-40da-a249-56a8a68ec276") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:04.971737 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:04.971663    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret podName:8919e466-cff0-4c4f-b85d-b98ca5f4bbe1 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:05.971655093 +0000 UTC m=+3.033116471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret") pod "global-pull-secret-syncer-69zk4" (UID: "8919e466-cff0-4c4f-b85d-b98ca5f4bbe1") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:05.055714 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:05.055675    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b906bc_8445_4b46_9236_9d66b897c705.slice/crio-cc4641b64fb65d3af96a22510a5d3ff904c8968df92046ff42449d451c59ab87 WatchSource:0}: Error finding container cc4641b64fb65d3af96a22510a5d3ff904c8968df92046ff42449d451c59ab87: Status 404 returned error can't find the container with id cc4641b64fb65d3af96a22510a5d3ff904c8968df92046ff42449d451c59ab87
Jul 30 22:40:05.072476 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.072441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:05.072666 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.072627    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:05.072666 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.072647    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:05.072666 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.072658    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8zmgc for pod openshift-network-diagnostics/network-check-target-t7t4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:05.072829 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.072713    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc podName:904a8475-32f4-4b6c-b752-2313b576ef64 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:06.072697858 +0000 UTC m=+3.134159234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zmgc" (UniqueName: "kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc") pod "network-check-target-t7t4k" (UID: "904a8475-32f4-4b6c-b752-2313b576ef64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:05.404303 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.404190    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:35:05 +0000 UTC" deadline="2028-01-31 08:43:50.76255952 +0000 UTC"
Jul 30 22:40:05.404303 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.404240    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13186h3m45.358325261s"
Jul 30 22:40:05.515377 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.515289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vtq5" event={"ID":"6e63f9ed-05f2-4b20-8952-71b930abe223","Type":"ContainerStarted","Data":"7e621a2c7a13f8c5763f230e8736367f48aa49c741de95ff5a720a03386c0703"}
Jul 30 22:40:05.519389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.519343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jznvw" event={"ID":"4096f4c0-18c1-414f-ba76-8a3e0620276f","Type":"ContainerStarted","Data":"d4b693cad5c4d46440921c77edc2dd5d79527c61a29d4524cba03474945e3d7b"}
Jul 30 22:40:05.522186 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.522118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerStarted","Data":"4648d1b228fa3edacef1e09259d361101fff8d9b01312e55828d9ce674033390"}
Jul 30 22:40:05.524761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.524721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mwcds" event={"ID":"8379cc47-c521-4660-9c0d-a40f4e63ea13","Type":"ContainerStarted","Data":"5575df97204336d1c6e4714378e57026cea36c8054393882d7da4e8f8a06c354"}
Jul 30 22:40:05.527590 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.527556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r" event={"ID":"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86","Type":"ContainerStarted","Data":"058f814d1089294ea9c66a0ce9bda5d1beff297c34da320bfcc111cb61795296"}
Jul 30 22:40:05.530682 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.530646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" event={"ID":"883f0f6eccee17e7b34cc6fea681db6a","Type":"ContainerStarted","Data":"83ce261d01484bf69490ca8f14f7c5aaa11bddb59707456bf09f6c8882766ada"}
Jul 30 22:40:05.533802 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.533745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal" event={"ID":"518fa4cb778829bfdb295bed0f31592e","Type":"ContainerStarted","Data":"4b401c458bc8dbd934f39a8804350e7cd03bad8203419dcb019e5dc8f170f62b"}
Jul 30 22:40:05.540614 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.540542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5c5m" event={"ID":"51b906bc-8445-4b46-9236-9d66b897c705","Type":"ContainerStarted","Data":"cc4641b64fb65d3af96a22510a5d3ff904c8968df92046ff42449d451c59ab87"}
Jul 30 22:40:05.542614 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.542471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"ddbfc4979842d52753d89896ff3a5a68d2c6a677fd1400f03b63bc06eff53fa8"}
Jul 30 22:40:05.558804 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.558702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hx64f" event={"ID":"66db1610-68b5-4de1-a3b3-89c9da98924c","Type":"ContainerStarted","Data":"acbc8cccb3b4629d94f57a1ce93609ea287e5c83681e47d38fa64a00f825fbc3"}
Jul 30 22:40:05.564626 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.564500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tmhdj" event={"ID":"def3da5d-7c3b-42d9-8342-fb48afcecb4e","Type":"ContainerStarted","Data":"a7ce8a8daa9fbafaedaa7d4cbcdc99bda3b1e8bda24531843add23c1fc19eb44"}
Jul 30 22:40:05.877577 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.877484    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:05.988891 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.988196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:05.988891 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:05.988264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:05.988891 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.988414    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:05.988891 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.988479    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret podName:8919e466-cff0-4c4f-b85d-b98ca5f4bbe1 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:07.98845942 +0000 UTC m=+5.049920799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret") pod "global-pull-secret-syncer-69zk4" (UID: "8919e466-cff0-4c4f-b85d-b98ca5f4bbe1") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:05.988891 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.988800    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:05.988891 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:05.988861    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs podName:32b3fce6-25a2-40da-a249-56a8a68ec276 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:07.988844149 +0000 UTC m=+5.050305528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs") pod "network-metrics-daemon-rfbsc" (UID: "32b3fce6-25a2-40da-a249-56a8a68ec276") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:06.089108 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:06.089071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:06.089325 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:06.089270    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:06.089325 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:06.089291    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:06.089325 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:06.089303    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8zmgc for pod openshift-network-diagnostics/network-check-target-t7t4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:06.089690 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:06.089368    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc podName:904a8475-32f4-4b6c-b752-2313b576ef64 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:08.089346555 +0000 UTC m=+5.150807953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zmgc" (UniqueName: "kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc") pod "network-check-target-t7t4k" (UID: "904a8475-32f4-4b6c-b752-2313b576ef64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:06.404501 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:06.404402    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:35:05 +0000 UTC" deadline="2028-03-21 12:51:26.021024634 +0000 UTC"
Jul 30 22:40:06.404501 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:06.404475    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14390h11m19.616554205s"
Jul 30 22:40:06.464205 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:06.464171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:06.464406 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:06.464322    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:06.464827 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:06.464802    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:06.464968 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:06.464944    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:06.465074 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:06.465057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:06.465166 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:06.465146    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:08.006438 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:08.006394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:08.006982 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.006854    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:08.006982 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.006937    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs podName:32b3fce6-25a2-40da-a249-56a8a68ec276 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:12.006915361 +0000 UTC m=+9.068376752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs") pod "network-metrics-daemon-rfbsc" (UID: "32b3fce6-25a2-40da-a249-56a8a68ec276") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:08.007741 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:08.007419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:08.007741 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.007597    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:08.007741 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.007674    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret podName:8919e466-cff0-4c4f-b85d-b98ca5f4bbe1 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:12.007635868 +0000 UTC m=+9.069097248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret") pod "global-pull-secret-syncer-69zk4" (UID: "8919e466-cff0-4c4f-b85d-b98ca5f4bbe1") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:08.107923 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:08.107879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:08.108160 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.108107    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:08.108160 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.108130    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:08.108160 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.108144    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8zmgc for pod openshift-network-diagnostics/network-check-target-t7t4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:08.108334 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.108210    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc podName:904a8475-32f4-4b6c-b752-2313b576ef64 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:12.108189947 +0000 UTC m=+9.169651346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zmgc" (UniqueName: "kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc") pod "network-check-target-t7t4k" (UID: "904a8475-32f4-4b6c-b752-2313b576ef64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:08.464954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:08.463938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:08.464954 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.464096    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:08.464954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:08.464511    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:08.464954 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.464626    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:08.464954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:08.464706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:08.464954 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:08.464826    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:10.464012 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:10.463969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:10.464499 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:10.464145    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:10.464624 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:10.464602    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:10.464734 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:10.464715    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:10.464929 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:10.464789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:10.464929 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:10.464876    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:12.046999 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:12.046753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:12.047427 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.047026    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:12.047427 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:12.047038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:12.047427 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.047101    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs podName:32b3fce6-25a2-40da-a249-56a8a68ec276 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:20.047081016 +0000 UTC m=+17.108542397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs") pod "network-metrics-daemon-rfbsc" (UID: "32b3fce6-25a2-40da-a249-56a8a68ec276") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:12.047427 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.047202    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:12.047427 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.047239    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret podName:8919e466-cff0-4c4f-b85d-b98ca5f4bbe1 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:20.047228 +0000 UTC m=+17.108689376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret") pod "global-pull-secret-syncer-69zk4" (UID: "8919e466-cff0-4c4f-b85d-b98ca5f4bbe1") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:12.148457 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:12.148358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:12.148674 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.148571    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:12.148674 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.148619    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:12.148674 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.148634    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8zmgc for pod openshift-network-diagnostics/network-check-target-t7t4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:12.148846 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.148705    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc podName:904a8475-32f4-4b6c-b752-2313b576ef64 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:20.14868507 +0000 UTC m=+17.210146447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zmgc" (UniqueName: "kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc") pod "network-check-target-t7t4k" (UID: "904a8475-32f4-4b6c-b752-2313b576ef64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:12.463895 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:12.463800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:12.464075 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.463941    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:12.464368 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:12.464349    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:12.464465 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.464453    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:12.464518 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:12.464497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:12.464627 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:12.464570    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:14.463359 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:14.463285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:14.463802 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:14.463372    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:14.463802 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:14.463474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:14.463802 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:14.463496    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:14.463802 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:14.463602    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:14.463802 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:14.463667    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:16.463673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:16.463639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:16.464127 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:16.463762    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:16.464127 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:16.463638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:16.464127 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:16.463841    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:16.464127 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:16.463639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:16.464127 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:16.463926    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:18.463170 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:18.463126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:18.463170 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:18.463184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:18.463746 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:18.463184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:18.463746 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:18.463271    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:18.463746 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:18.463411    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:18.463746 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:18.463497    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:20.105700 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:20.105651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:20.106127 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:20.105759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:20.106127 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.105812    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:20.106127 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.105860    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:20.106127 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.105878    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret podName:8919e466-cff0-4c4f-b85d-b98ca5f4bbe1 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:36.105861607 +0000 UTC m=+33.167322981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret") pod "global-pull-secret-syncer-69zk4" (UID: "8919e466-cff0-4c4f-b85d-b98ca5f4bbe1") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:20.106127 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.105899    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs podName:32b3fce6-25a2-40da-a249-56a8a68ec276 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:36.105887284 +0000 UTC m=+33.167348658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs") pod "network-metrics-daemon-rfbsc" (UID: "32b3fce6-25a2-40da-a249-56a8a68ec276") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:20.206668 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:20.206619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:20.206847 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.206800    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:20.206847 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.206832    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:20.206847 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.206847    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8zmgc for pod openshift-network-diagnostics/network-check-target-t7t4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:20.206988 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.206908    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc podName:904a8475-32f4-4b6c-b752-2313b576ef64 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:36.206891717 +0000 UTC m=+33.268353092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zmgc" (UniqueName: "kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc") pod "network-check-target-t7t4k" (UID: "904a8475-32f4-4b6c-b752-2313b576ef64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:20.463308 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:20.463211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:20.463308 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:20.463242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:20.463681 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:20.463221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:20.463681 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.463350    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:20.463681 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.463439    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:20.463681 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:20.463522    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:22.463681 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:22.463627    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:22.463681 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:22.463674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:22.464221 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:22.463645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:22.464221 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:22.463781    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:22.464221 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:22.463869    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:22.464221 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:22.463957    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:24.464567 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:24.463792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:24.464567 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:24.463930    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:24.464567 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:24.464323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:24.464567 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:24.464423    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:24.464567 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:24.464465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:24.464567 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:24.464529    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:26.464108 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.463221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:26.464108 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:26.463707    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:26.464108 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.463481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:26.464108 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:26.463813    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:26.464108 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.463432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:26.464108 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:26.463911    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:26.626816 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.626778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jznvw" event={"ID":"4096f4c0-18c1-414f-ba76-8a3e0620276f","Type":"ContainerStarted","Data":"6f0cc9d12eba3a90fc749c239fd9d7ccbc9b428fbd7c6f9e7978f74cdbb1ab26"}
Jul 30 22:40:26.628519 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.628483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal" event={"ID":"518fa4cb778829bfdb295bed0f31592e","Type":"ContainerStarted","Data":"3dfc5f47e7e80e42bedc21a9084d9ff05b3689f98173c2a8fa453e4cd0a5b3e8"}
Jul 30 22:40:26.631238 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.631218    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:40:26.631670 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.631649    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba923054-f26a-4130-a790-c0f19e2cfcf3" containerID="6acf4aeacbaea8469525c6a07a32f2591d91bc1130457ddec0ff7b815395a44f" exitCode=1
Jul 30 22:40:26.631754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.631712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerDied","Data":"6acf4aeacbaea8469525c6a07a32f2591d91bc1130457ddec0ff7b815395a44f"}
Jul 30 22:40:26.631809 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.631780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"338492ff35c946cbeaa1248cd759506d6ab43b422ef02d72df03f9988299f6ab"}
Jul 30 22:40:26.633235 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.633214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tmhdj" event={"ID":"def3da5d-7c3b-42d9-8342-fb48afcecb4e","Type":"ContainerStarted","Data":"a87dae73543857aa30d3b061b58b3f598f8d2e06b21034dfcc6cd178452487ab"}
Jul 30 22:40:26.643825 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.643773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jznvw" podStartSLOduration=1.487408067 podStartE2EDuration="22.643758092s" totalImagesPullingTime="21.156350025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:26.643559258 +0000 UTC m=+23.705020651" watchObservedRunningTime="2026-07-30 22:40:26.643758092 +0000 UTC m=+23.705219528"
Jul 30 22:40:26.659322 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.659260    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tmhdj" podStartSLOduration=1.492703777 podStartE2EDuration="22.659182072s" totalImagesPullingTime="21.166478295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:26.658769831 +0000 UTC m=+23.720231227" watchObservedRunningTime="2026-07-30 22:40:26.659182072 +0000 UTC m=+23.720643468"
Jul 30 22:40:26.674484 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:26.674424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-134.ec2.internal" podStartSLOduration=22.674405358 podStartE2EDuration="22.674405358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:26.673399635 +0000 UTC m=+23.734861023" watchObservedRunningTime="2026-07-30 22:40:26.674405358 +0000 UTC m=+23.735866755"
Jul 30 22:40:27.637333 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.637077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vtq5" event={"ID":"6e63f9ed-05f2-4b20-8952-71b930abe223","Type":"ContainerStarted","Data":"67c784c908a057e6262847a719f79434e924500e53af88a3b0738be936c3498a"}
Jul 30 22:40:27.638716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.638687    2565 generic.go:356] "Generic (PLEG): container finished" podID="f046a693-f7fb-4768-9f0b-2ab613660a9f" containerID="a42edf302799354ae78d2fd4c3df0f06c64da27848110cce3186f154bccd21c0" exitCode=0
Jul 30 22:40:27.638837 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.638773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerDied","Data":"a42edf302799354ae78d2fd4c3df0f06c64da27848110cce3186f154bccd21c0"}
Jul 30 22:40:27.640184 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.640096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mwcds" event={"ID":"8379cc47-c521-4660-9c0d-a40f4e63ea13","Type":"ContainerStarted","Data":"f21f6db39da0a9130ddd86b854b5e987fe86fef01b0db559c8de5eb31d892f28"}
Jul 30 22:40:27.641728 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.641704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r" event={"ID":"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86","Type":"ContainerStarted","Data":"63f84822bb05092b4b2cd968b5cc93a62d07dbd04fd6733e7fd4d575428173e4"}
Jul 30 22:40:27.643128 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.643094    2565 generic.go:356] "Generic (PLEG): container finished" podID="883f0f6eccee17e7b34cc6fea681db6a" containerID="d4de1d37924d5416fa1ffe845f1a4ea775927a3d4c8de7696055251b9a08d06e" exitCode=0
Jul 30 22:40:27.643241 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.643133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" event={"ID":"883f0f6eccee17e7b34cc6fea681db6a","Type":"ContainerDied","Data":"d4de1d37924d5416fa1ffe845f1a4ea775927a3d4c8de7696055251b9a08d06e"}
Jul 30 22:40:27.644683 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.644658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5c5m" event={"ID":"51b906bc-8445-4b46-9236-9d66b897c705","Type":"ContainerStarted","Data":"7da3ce9246283b9900c87b2f3fe325bf3db0c38a1b020ea8a0945a022fe964a4"}
Jul 30 22:40:27.647500 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.647480    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:40:27.647856 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.647837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"9b021a6de70741fc4cc6c1f8edb24cc98df829a2ded8ef440988a75e9d2baabd"}
Jul 30 22:40:27.647919 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.647905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"a4d089128cba7e310eefd996b0ff2bf3fbce5b3783abfe4aeb0e405f2299dc7e"}
Jul 30 22:40:27.647964 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.647952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"cd848bf9062d817749de15ae4ef04e2cdb1ef1d8e6c433b2bbd99abb34c77126"}
Jul 30 22:40:27.647999 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.647982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"67f4c1d66b999e56f6812765b4b884b36ee108532ec189cf58bc0a496a5762bf"}
Jul 30 22:40:27.649174 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.649145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hx64f" event={"ID":"66db1610-68b5-4de1-a3b3-89c9da98924c","Type":"ContainerStarted","Data":"91f75b1b86ba8fbcb5c62f5fc440c60f46f88b4af5c578ee7d30ce614957850d"}
Jul 30 22:40:27.650972 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.650935    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8vtq5" podStartSLOduration=2.672238933 podStartE2EDuration="23.650922082s" totalImagesPullingTime="20.978683149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:27.650555148 +0000 UTC m=+24.712016544" watchObservedRunningTime="2026-07-30 22:40:27.650922082 +0000 UTC m=+24.712383478"
Jul 30 22:40:27.662785 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.662735    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mwcds" podStartSLOduration=2.500610391 podStartE2EDuration="23.662718393s" totalImagesPullingTime="21.162108002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:27.662605586 +0000 UTC m=+24.724066984" watchObservedRunningTime="2026-07-30 22:40:27.662718393 +0000 UTC m=+24.724179788"
Jul 30 22:40:27.679916 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.679837    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hx64f" podStartSLOduration=2.581426355 podStartE2EDuration="23.679820069s" totalImagesPullingTime="21.098393714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:27.6797998 +0000 UTC m=+24.741261198" watchObservedRunningTime="2026-07-30 22:40:27.679820069 +0000 UTC m=+24.741281465"
Jul 30 22:40:27.694730 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:27.694682    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d5c5m" podStartSLOduration=2.892216256 podStartE2EDuration="23.694661675s" totalImagesPullingTime="20.802445419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:27.694256845 +0000 UTC m=+24.755718241" watchObservedRunningTime="2026-07-30 22:40:27.694661675 +0000 UTC m=+24.756123072"
Jul 30 22:40:28.464072 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:28.464028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:28.464368 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:28.464159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:28.464368 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:28.464170    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:28.464368 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:28.464172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:28.464368 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:28.464271    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:28.464368 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:28.464364    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:28.656734 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:28.656664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" event={"ID":"883f0f6eccee17e7b34cc6fea681db6a","Type":"ContainerStarted","Data":"2f22dc881ce8929440178c700ea7ef485c81150ad2d4fd77f8c2039e6d3684dc"}
Jul 30 22:40:28.671112 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:28.671055    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-134.ec2.internal" podStartSLOduration=24.671039296 podStartE2EDuration="24.671039296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:28.670425985 +0000 UTC m=+25.731887382" watchObservedRunningTime="2026-07-30 22:40:28.671039296 +0000 UTC m=+25.732500695"
Jul 30 22:40:28.723877 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:28.723848    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 22:40:29.437654 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:29.437515    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T22:40:28.723872014Z","UUID":"9f4eaf2e-0680-4440-ad31-613eac51dac8","Handler":null,"Name":"","Endpoint":""}
Jul 30 22:40:29.439566 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:29.439540    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 22:40:29.439796 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:29.439644    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 22:40:29.661468 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:29.661376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r" event={"ID":"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86","Type":"ContainerStarted","Data":"bab80022367895741f0a8470f9049be3dc1d50106fcf7cbae6b5b43d79630618"}
Jul 30 22:40:29.665898 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:29.665865    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:40:29.666321 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:29.666291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"f63ca7037a63cd086c779375dd3fb3877ff5fcaea245b14eb1ba6860e00512bf"}
Jul 30 22:40:30.464164 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:30.463909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:30.464335 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:30.464220    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:30.464335 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:30.463971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:30.464417 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:30.464331    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:30.464417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:30.463954    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:30.464417 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:30.464402    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:30.670341 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:30.670307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r" event={"ID":"9f5dbc92-ab67-4d0f-9e64-5acb993d4e86","Type":"ContainerStarted","Data":"176db6f867e54fcafcd4fb92009403e3b1e55a875e1fbb9d76c326114536344c"}
Jul 30 22:40:30.688242 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:30.688188    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2t79r" podStartSLOduration=2.666654557 podStartE2EDuration="26.688174081s" totalImagesPullingTime="24.021519524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:30.687869489 +0000 UTC m=+27.749330888" watchObservedRunningTime="2026-07-30 22:40:30.688174081 +0000 UTC m=+27.749635477"
Jul 30 22:40:31.579053 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:31.578956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:31.579816 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:31.579660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:31.681434 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:31.681329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:40:31.682712 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:31.681949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"322caa99d236bcbce3201a9c4c0bed77b2c94b6608c538c120f6c25df9a05c82"}
Jul 30 22:40:31.682915 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:31.682891    2565 scope.go:117] "RemoveContainer" containerID="6acf4aeacbaea8469525c6a07a32f2591d91bc1130457ddec0ff7b815395a44f"
Jul 30 22:40:32.463534 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:32.463486    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:32.463534 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:32.463522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:32.463803 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:32.463624    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:32.463803 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:32.463647    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:32.463803 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:32.463711    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:32.463803 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:32.463790    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:33.688057 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.688016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerStarted","Data":"0df877a51e2fe607b26ed83af5ccc51f15a12dcb26c49d98dc3f688bb51d28da"}
Jul 30 22:40:33.691855 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.691827    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:40:33.692228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.692200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" event={"ID":"ba923054-f26a-4130-a790-c0f19e2cfcf3","Type":"ContainerStarted","Data":"f7cd9963ae1feab5338d280bcadb0dc455a4bd63f0047677f4c7a490417117dd"}
Jul 30 22:40:33.692592 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.692517    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:33.692706 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.692636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:33.692706 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.692684    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:33.709631 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.709603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:33.709819 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.709711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:40:33.730024 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.729968    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm" podStartSLOduration=8.267084052 podStartE2EDuration="29.729952382s" totalImagesPullingTime="21.46286833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:33.729472059 +0000 UTC m=+30.790933456" watchObservedRunningTime="2026-07-30 22:40:33.729952382 +0000 UTC m=+30.791413822"
Jul 30 22:40:33.736347 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.736309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-69zk4"]
Jul 30 22:40:33.736502 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.736450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:33.736680 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:33.736561    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:33.738640 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.738616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t7t4k"]
Jul 30 22:40:33.738772 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.738744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:33.738886 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:33.738866    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:33.748177 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.748141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rfbsc"]
Jul 30 22:40:33.748327 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:33.748290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:33.748461 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:33.748438    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:34.351407 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:34.351368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:34.351630 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:34.351520    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 22:40:34.352066 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:34.352041    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8vtq5"
Jul 30 22:40:34.696727 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:34.696622    2565 generic.go:356] "Generic (PLEG): container finished" podID="f046a693-f7fb-4768-9f0b-2ab613660a9f" containerID="0df877a51e2fe607b26ed83af5ccc51f15a12dcb26c49d98dc3f688bb51d28da" exitCode=0
Jul 30 22:40:34.696727 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:34.696715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerDied","Data":"0df877a51e2fe607b26ed83af5ccc51f15a12dcb26c49d98dc3f688bb51d28da"}
Jul 30 22:40:35.464498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:35.463984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:35.464498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:35.464030    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:35.464498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:35.463984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:35.464498 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:35.464132    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:35.464498 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:35.464218    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:35.464498 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:35.464314    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:35.700783 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:35.700746    2565 generic.go:356] "Generic (PLEG): container finished" podID="f046a693-f7fb-4768-9f0b-2ab613660a9f" containerID="c962af4bfd6f894cf085da2325019bdf91d9082c6079b0b533f06e7962ca7625" exitCode=0
Jul 30 22:40:35.701262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:35.700848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerDied","Data":"c962af4bfd6f894cf085da2325019bdf91d9082c6079b0b533f06e7962ca7625"}
Jul 30 22:40:36.130620 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:36.130565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:36.130850 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:36.130655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:36.130850 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.130686    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:36.130850 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.130737    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:36.130850 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.130756    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret podName:8919e466-cff0-4c4f-b85d-b98ca5f4bbe1 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:08.130738881 +0000 UTC m=+65.192200259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret") pod "global-pull-secret-syncer-69zk4" (UID: "8919e466-cff0-4c4f-b85d-b98ca5f4bbe1") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:36.130850 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.130775    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs podName:32b3fce6-25a2-40da-a249-56a8a68ec276 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:08.130763394 +0000 UTC m=+65.192224767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs") pod "network-metrics-daemon-rfbsc" (UID: "32b3fce6-25a2-40da-a249-56a8a68ec276") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:36.231005 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:36.230972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:36.231177 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.231134    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:36.231177 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.231157    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:36.231177 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.231174    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8zmgc for pod openshift-network-diagnostics/network-check-target-t7t4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:36.231284 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:36.231241    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc podName:904a8475-32f4-4b6c-b752-2313b576ef64 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:08.231223102 +0000 UTC m=+65.292684495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8zmgc" (UniqueName: "kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc") pod "network-check-target-t7t4k" (UID: "904a8475-32f4-4b6c-b752-2313b576ef64") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:36.709165 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:36.709079    2565 generic.go:356] "Generic (PLEG): container finished" podID="f046a693-f7fb-4768-9f0b-2ab613660a9f" containerID="94e4330309728b6b419b4517eb7ff725bedc16e6b9655a569801a3ccc110286f" exitCode=0
Jul 30 22:40:36.709165 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:36.709131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerDied","Data":"94e4330309728b6b419b4517eb7ff725bedc16e6b9655a569801a3ccc110286f"}
Jul 30 22:40:37.463966 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:37.463920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:37.464168 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:37.463995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:37.464168 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:37.464016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:37.464168 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:37.464102    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:37.464635 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:37.464472    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:37.464635 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:37.464597    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:39.463717 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.463683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:39.464194 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.463696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:39.464194 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.463830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:39.464194 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.463818    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t7t4k" podUID="904a8475-32f4-4b6c-b752-2313b576ef64"
Jul 30 22:40:39.464194 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.463947    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-69zk4" podUID="8919e466-cff0-4c4f-b85d-b98ca5f4bbe1"
Jul 30 22:40:39.464194 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.464031    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfbsc" podUID="32b3fce6-25a2-40da-a249-56a8a68ec276"
Jul 30 22:40:39.691909 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.691882    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-134.ec2.internal" event="NodeReady"
Jul 30 22:40:39.692076 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.692026    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 22:40:39.725940 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.725863    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5868bd47d6-274tz"]
Jul 30 22:40:39.730400 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.730361    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"]
Jul 30 22:40:39.730562 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.730510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.732882 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.732857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 22:40:39.732882 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.732864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f59gl\""
Jul 30 22:40:39.733849 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.733823    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"]
Jul 30 22:40:39.733958 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.733946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.739942 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.739912    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 22:40:39.740095 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.740034    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 22:40:39.740367 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.740245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.740367 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.740295    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.740556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.740435    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fxmmh\""
Jul 30 22:40:39.740556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.740483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 22:40:39.742403 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.742384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 22:40:39.742788 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.742767    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"]
Jul 30 22:40:39.742994 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.742973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.745689 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.745633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 22:40:39.745906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.745879    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.746250 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.746231    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 22:40:39.746570 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.746553    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 22:40:39.746832 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.746770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5hz7z\""
Jul 30 22:40:39.747743 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.747120    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.748678 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.748393    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"]
Jul 30 22:40:39.748678 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.748610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:39.750909 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.750889    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nvvgp\""
Jul 30 22:40:39.751226 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.751210    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 22:40:39.751434 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.751417    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 22:40:39.752276 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.752255    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"]
Jul 30 22:40:39.752674 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.752650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:39.756443 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.755299    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5xcgf\""
Jul 30 22:40:39.756443 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.755517    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 30 22:40:39.756443 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.755729    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.756443 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.756279    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.757548 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.757475    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-8wrtv"]
Jul 30 22:40:39.758165 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.758147    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.760342 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.760326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7k7wc\""
Jul 30 22:40:39.762278 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.762095    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.762526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.762140    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 22:40:39.762719 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.762699    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.763128 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.763109    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 22:40:39.763257 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.763220    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5v87q"]
Jul 30 22:40:39.763461 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.763319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.768612 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.768188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.768612 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.768468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 22:40:39.778062 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.778029    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.780697 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.780635    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"]
Jul 30 22:40:39.782639 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.782614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.784829 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.784804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 22:40:39.785187 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.785154    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g8rdh\""
Jul 30 22:40:39.785340 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.785316    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 22:40:39.785791 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.785768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 22:40:39.786088 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.786066    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cqmw\""
Jul 30 22:40:39.787080 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.787059    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 22:40:39.787741 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.787722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5868bd47d6-274tz"]
Jul 30 22:40:39.787860 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.787775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"
Jul 30 22:40:39.787967 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.787895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"]
Jul 30 22:40:39.788093 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.788079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"]
Jul 30 22:40:39.793738 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.793705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"]
Jul 30 22:40:39.793906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.793754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"]
Jul 30 22:40:39.793906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.793777    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"]
Jul 30 22:40:39.793906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.793809    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-lm6hk"]
Jul 30 22:40:39.794061 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.793921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.795861 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.795838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z8fgb\""
Jul 30 22:40:39.796024 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.795980    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.797189 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.797170    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bfdd7b448-4nxrm"]
Jul 30 22:40:39.797412 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.797397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:39.799947 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.799893    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.799947 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.799923    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-v8ggb\""
Jul 30 22:40:39.800114 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.800071    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 22:40:39.800400 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.800290    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.800400 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.800368    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"]
Jul 30 22:40:39.800543 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.800489    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 22:40:39.800635 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.800598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:39.802869 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.802849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 30 22:40:39.802973 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.802947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.803591 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.803555    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.803687 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.803555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 30 22:40:39.803750 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.803622    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 30 22:40:39.803750 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.803735    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4v9q7\""
Jul 30 22:40:39.803750 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.803533    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 30 22:40:39.804214 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.804197    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nxx6m"]
Jul 30 22:40:39.804325 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.804307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"
Jul 30 22:40:39.805405 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.805381    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 22:40:39.806711 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.806692    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8xhw7\""
Jul 30 22:40:39.806824 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.806705    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.806936 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.806705    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.807254 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"]
Jul 30 22:40:39.807353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807268    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-8wrtv"]
Jul 30 22:40:39.807353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5v87q"]
Jul 30 22:40:39.807353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"]
Jul 30 22:40:39.807353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807334    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxx6m"]
Jul 30 22:40:39.807353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-lm6hk"]
Jul 30 22:40:39.807598 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bfdd7b448-4nxrm"]
Jul 30 22:40:39.807598 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.807399    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:39.809532 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.809513    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 22:40:39.809899 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.809881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 22:40:39.810107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.810091    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 22:40:39.810278 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.810262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-npr54\""
Jul 30 22:40:39.856623 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-image-registry-private-configuration\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.856761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5ffafa8-d18e-49ef-8438-fb6b87c81825-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.856761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b9fcb69-990d-4384-8efb-787b257a2e02-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:39.856761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.856913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4qt\" (UniqueName: \"kubernetes.io/projected/89ba195e-3d52-451c-a332-22b775a0d236-kube-api-access-dw4qt\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.856913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.856913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:39.856913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.856913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:39.857109 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-service-ca-bundle\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.857109 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k74xk\" (UniqueName: \"kubernetes.io/projected/f5ffafa8-d18e-49ef-8438-fb6b87c81825-kube-api-access-k74xk\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.857109 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.856988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-snapshots\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.857109 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-installation-pull-secrets\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.857109 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjdcx\" (UniqueName: \"kubernetes.io/projected/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-kube-api-access-pjdcx\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.857109 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba195e-3d52-451c-a332-22b775a0d236-serving-cert\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.857366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89ba195e-3d52-451c-a332-22b775a0d236-config\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.857366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5ffafa8-d18e-49ef-8438-fb6b87c81825-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.857366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgzhz\" (UniqueName: \"kubernetes.io/projected/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-kube-api-access-dgzhz\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.857366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-serving-cert\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.857366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-certificates\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.857366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d8c414b-ec44-4ea6-832c-8f378ce019de-config-volume\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.857366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.857716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-trusted-ca\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.857716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8c414b-ec44-4ea6-832c-8f378ce019de-tmp-dir\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.857716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkmnw\" (UniqueName: \"kubernetes.io/projected/d7258991-e5c6-4522-84a2-3116b9f8e43b-kube-api-access-lkmnw\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:39.857716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkjwl\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-kube-api-access-dkjwl\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.857716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxt5t\" (UniqueName: \"kubernetes.io/projected/92ac6874-d309-4917-849d-9d5ce7f45d2e-kube-api-access-fxt5t\") pod \"volume-data-source-validator-5b8776669-nhzzm\" (UID: \"92ac6874-d309-4917-849d-9d5ce7f45d2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"
Jul 30 22:40:39.857716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xq2l\" (UniqueName: \"kubernetes.io/projected/4d8c414b-ec44-4ea6-832c-8f378ce019de-kube-api-access-2xq2l\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.857716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-trusted-ca-bundle\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.858066 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-tmp\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.858066 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.857997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c53891e3-2830-4fb9-a938-deb9aab64fed-ca-trust-extracted\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.858066 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.858017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-bound-sa-token\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.885634 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.885557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:39.958675 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.958635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-config\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:39.958675 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.958686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.958947 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.958716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbhp\" (UniqueName: \"kubernetes.io/projected/df296acf-fa13-4131-bffa-9ba389ab759a-kube-api-access-lfbhp\") pod \"network-check-source-65bdbbff45-hvnsp\" (UID: \"df296acf-fa13-4131-bffa-9ba389ab759a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"
Jul 30 22:40:39.958947 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.958766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4qt\" (UniqueName: \"kubernetes.io/projected/89ba195e-3d52-451c-a332-22b775a0d236-kube-api-access-dw4qt\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.958947 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.958839    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 22:40:39.958947 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.958904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.958947 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.958932    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls podName:4d8c414b-ec44-4ea6-832c-8f378ce019de nodeName:}" failed. No retries permitted until 2026-07-30 22:40:40.458908744 +0000 UTC m=+37.520370137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls") pod "dns-default-5v87q" (UID: "4d8c414b-ec44-4ea6-832c-8f378ce019de") : secret "dns-default-metrics-tls" not found
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.958975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc665\" (UniqueName: \"kubernetes.io/projected/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-kube-api-access-cc665\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0287a25-f1f5-43f4-8585-7c0d0f3545b1-cert\") pod \"ingress-canary-nxx6m\" (UID: \"f0287a25-f1f5-43f4-8585-7c0d0f3545b1\") " pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-trusted-ca\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bctsj\" (UniqueName: \"kubernetes.io/projected/f0287a25-f1f5-43f4-8585-7c0d0f3545b1-kube-api-access-bctsj\") pod \"ingress-canary-nxx6m\" (UID: \"f0287a25-f1f5-43f4-8585-7c0d0f3545b1\") " pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.959168    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-service-ca-bundle\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.959201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k74xk\" (UniqueName: \"kubernetes.io/projected/f5ffafa8-d18e-49ef-8438-fb6b87c81825-kube-api-access-k74xk\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-default-certificate\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-snapshots\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-installation-pull-secrets\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjdcx\" (UniqueName: \"kubernetes.io/projected/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-kube-api-access-pjdcx\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.959302    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.959307    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert podName:6b9fcb69-990d-4384-8efb-787b257a2e02 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:40.459292735 +0000 UTC m=+37.520754111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8lwtm" (UID: "6b9fcb69-990d-4384-8efb-787b257a2e02") : secret "networking-console-plugin-cert" not found
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.959321    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5868bd47d6-274tz: secret "image-registry-tls" not found
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.959374    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls podName:c53891e3-2830-4fb9-a938-deb9aab64fed nodeName:}" failed. No retries permitted until 2026-07-30 22:40:40.459363091 +0000 UTC m=+37.520824465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls") pod "image-registry-5868bd47d6-274tz" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed") : secret "image-registry-tls" not found
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba195e-3d52-451c-a332-22b775a0d236-serving-cert\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89ba195e-3d52-451c-a332-22b775a0d236-config\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5ffafa8-d18e-49ef-8438-fb6b87c81825-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.959503    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgzhz\" (UniqueName: \"kubernetes.io/projected/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-kube-api-access-dgzhz\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.959679 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.959535    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls podName:d7258991-e5c6-4522-84a2-3116b9f8e43b nodeName:}" failed. No retries permitted until 2026-07-30 22:40:40.459525061 +0000 UTC m=+37.520986436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tvzz2" (UID: "d7258991-e5c6-4522-84a2-3116b9f8e43b") : secret "samples-operator-tls" not found
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-serving-cert\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-certificates\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d8c414b-ec44-4ea6-832c-8f378ce019de-config-volume\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-trusted-ca\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8c414b-ec44-4ea6-832c-8f378ce019de-tmp-dir\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-serving-cert\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmnw\" (UniqueName: \"kubernetes.io/projected/d7258991-e5c6-4522-84a2-3116b9f8e43b-kube-api-access-lkmnw\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-stats-auth\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkjwl\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-kube-api-access-dkjwl\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxt5t\" (UniqueName: \"kubernetes.io/projected/92ac6874-d309-4917-849d-9d5ce7f45d2e-kube-api-access-fxt5t\") pod \"volume-data-source-validator-5b8776669-nhzzm\" (UID: \"92ac6874-d309-4917-849d-9d5ce7f45d2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xmlv\" (UniqueName: \"kubernetes.io/projected/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-kube-api-access-6xmlv\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xq2l\" (UniqueName: \"kubernetes.io/projected/4d8c414b-ec44-4ea6-832c-8f378ce019de-kube-api-access-2xq2l\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-trusted-ca-bundle\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.960389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-tmp\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c53891e3-2830-4fb9-a938-deb9aab64fed-ca-trust-extracted\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.959938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-bound-sa-token\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.960005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-image-registry-private-configuration\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.960038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5ffafa8-d18e-49ef-8438-fb6b87c81825-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.960066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b9fcb69-990d-4384-8efb-787b257a2e02-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.960293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89ba195e-3d52-451c-a332-22b775a0d236-config\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.960310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8c414b-ec44-4ea6-832c-8f378ce019de-tmp-dir\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.960790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b9fcb69-990d-4384-8efb-787b257a2e02-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.961045    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:39.961181 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:39.961102    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls podName:ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef nodeName:}" failed. No retries permitted until 2026-07-30 22:40:40.461090792 +0000 UTC m=+37.522552166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-vvkps" (UID: "ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef") : secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:39.961716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.961308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-trusted-ca-bundle\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.961716 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.961469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c53891e3-2830-4fb9-a938-deb9aab64fed-ca-trust-extracted\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.961841 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.961813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-tmp\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.961970 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.961909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-service-ca-bundle\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.962367 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.962344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d8c414b-ec44-4ea6-832c-8f378ce019de-config-volume\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.962507 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.962433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-snapshots\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.962668 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.962549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5ffafa8-d18e-49ef-8438-fb6b87c81825-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.962752 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.962699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-certificates\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.962808 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.962779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-trusted-ca\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.965048 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.965023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89ba195e-3d52-451c-a332-22b775a0d236-serving-cert\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.965354 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.965331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5ffafa8-d18e-49ef-8438-fb6b87c81825-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.965558 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.965533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-installation-pull-secrets\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.965897 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.965872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-image-registry-private-configuration\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.966002 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.965982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-serving-cert\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.968532 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.968104    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjdcx\" (UniqueName: \"kubernetes.io/projected/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-kube-api-access-pjdcx\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:39.968532 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.968474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4qt\" (UniqueName: \"kubernetes.io/projected/89ba195e-3d52-451c-a332-22b775a0d236-kube-api-access-dw4qt\") pod \"service-ca-operator-784f97bcf6-2d6dh\" (UID: \"89ba195e-3d52-451c-a332-22b775a0d236\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:39.969801 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.969774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxt5t\" (UniqueName: \"kubernetes.io/projected/92ac6874-d309-4917-849d-9d5ce7f45d2e-kube-api-access-fxt5t\") pod \"volume-data-source-validator-5b8776669-nhzzm\" (UID: \"92ac6874-d309-4917-849d-9d5ce7f45d2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"
Jul 30 22:40:39.970260 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.970232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkjwl\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-kube-api-access-dkjwl\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.970921 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.970667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k74xk\" (UniqueName: \"kubernetes.io/projected/f5ffafa8-d18e-49ef-8438-fb6b87c81825-kube-api-access-k74xk\") pod \"kube-storage-version-migrator-operator-7878f4b88c-nl7fv\" (UID: \"f5ffafa8-d18e-49ef-8438-fb6b87c81825\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:39.971066 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.971044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-bound-sa-token\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:39.971144 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.971067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xq2l\" (UniqueName: \"kubernetes.io/projected/4d8c414b-ec44-4ea6-832c-8f378ce019de-kube-api-access-2xq2l\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:39.972173 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.972147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgzhz\" (UniqueName: \"kubernetes.io/projected/5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51-kube-api-access-dgzhz\") pod \"insights-operator-77696685b-8wrtv\" (UID: \"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51\") " pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:39.972862 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.972839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkmnw\" (UniqueName: \"kubernetes.io/projected/d7258991-e5c6-4522-84a2-3116b9f8e43b-kube-api-access-lkmnw\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:39.975405 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:39.975377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:40.061190 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-default-certificate\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.061375 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.061375 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-serving-cert\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.061375 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-stats-auth\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.061375 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.061568 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xmlv\" (UniqueName: \"kubernetes.io/projected/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-kube-api-access-6xmlv\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.061568 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.061432    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:40.561406304 +0000 UTC m=+37.622867701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : configmap references non-existent config key: service-ca.crt
Jul 30 22:40:40.061568 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-config\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.061568 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbhp\" (UniqueName: \"kubernetes.io/projected/df296acf-fa13-4131-bffa-9ba389ab759a-kube-api-access-lfbhp\") pod \"network-check-source-65bdbbff45-hvnsp\" (UID: \"df296acf-fa13-4131-bffa-9ba389ab759a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"
Jul 30 22:40:40.061814 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc665\" (UniqueName: \"kubernetes.io/projected/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-kube-api-access-cc665\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.061814 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0287a25-f1f5-43f4-8585-7c0d0f3545b1-cert\") pod \"ingress-canary-nxx6m\" (UID: \"f0287a25-f1f5-43f4-8585-7c0d0f3545b1\") " pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:40.061814 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-trusted-ca\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.061814 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.061749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bctsj\" (UniqueName: \"kubernetes.io/projected/f0287a25-f1f5-43f4-8585-7c0d0f3545b1-kube-api-access-bctsj\") pod \"ingress-canary-nxx6m\" (UID: \"f0287a25-f1f5-43f4-8585-7c0d0f3545b1\") " pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:40.062006 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.061850    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 22:40:40.062006 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.061920    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:40.561902196 +0000 UTC m=+37.623363571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : secret "router-metrics-certs-default" not found
Jul 30 22:40:40.062818 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.062776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-config\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.063155 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.063133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-trusted-ca\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.064420 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.064395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-default-certificate\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.064837 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.064797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-serving-cert\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.064958 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.064868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-stats-auth\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.066409 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.066367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0287a25-f1f5-43f4-8585-7c0d0f3545b1-cert\") pod \"ingress-canary-nxx6m\" (UID: \"f0287a25-f1f5-43f4-8585-7c0d0f3545b1\") " pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:40.071020 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.070965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bctsj\" (UniqueName: \"kubernetes.io/projected/f0287a25-f1f5-43f4-8585-7c0d0f3545b1-kube-api-access-bctsj\") pod \"ingress-canary-nxx6m\" (UID: \"f0287a25-f1f5-43f4-8585-7c0d0f3545b1\") " pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:40.071205 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.071098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc665\" (UniqueName: \"kubernetes.io/projected/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-kube-api-access-cc665\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.071205 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.071115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbhp\" (UniqueName: \"kubernetes.io/projected/df296acf-fa13-4131-bffa-9ba389ab759a-kube-api-access-lfbhp\") pod \"network-check-source-65bdbbff45-hvnsp\" (UID: \"df296acf-fa13-4131-bffa-9ba389ab759a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"
Jul 30 22:40:40.071332 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.071203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xmlv\" (UniqueName: \"kubernetes.io/projected/b716fefc-6f1c-4dfc-a5cd-e74ae8582fde-kube-api-access-6xmlv\") pod \"console-operator-5ccd6b445f-lm6hk\" (UID: \"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde\") " pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.095078 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.095007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"
Jul 30 22:40:40.118624 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.118564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"
Jul 30 22:40:40.126745 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.126705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-8wrtv"
Jul 30 22:40:40.142961 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.142924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"
Jul 30 22:40:40.150345 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.150298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:40.165863 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.165819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"
Jul 30 22:40:40.171967 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.171938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxx6m"
Jul 30 22:40:40.467414 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.467324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:40.467414 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.467373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.467426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467493    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467519    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5868bd47d6-274tz: secret "image-registry-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467550    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467557    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467601    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls podName:c53891e3-2830-4fb9-a938-deb9aab64fed nodeName:}" failed. No retries permitted until 2026-07-30 22:40:41.467563875 +0000 UTC m=+38.529025251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls") pod "image-registry-5868bd47d6-274tz" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed") : secret "image-registry-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467628    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls podName:d7258991-e5c6-4522-84a2-3116b9f8e43b nodeName:}" failed. No retries permitted until 2026-07-30 22:40:41.467610786 +0000 UTC m=+38.529072166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tvzz2" (UID: "d7258991-e5c6-4522-84a2-3116b9f8e43b") : secret "samples-operator-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467647    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls podName:ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef nodeName:}" failed. No retries permitted until 2026-07-30 22:40:41.467637988 +0000 UTC m=+38.529099367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-vvkps" (UID: "ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef") : secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.467700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.467742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467833    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467837    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467888    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert podName:6b9fcb69-990d-4384-8efb-787b257a2e02 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:41.46787545 +0000 UTC m=+38.529336830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8lwtm" (UID: "6b9fcb69-990d-4384-8efb-787b257a2e02") : secret "networking-console-plugin-cert" not found
Jul 30 22:40:40.468173 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.467902    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls podName:4d8c414b-ec44-4ea6-832c-8f378ce019de nodeName:}" failed. No retries permitted until 2026-07-30 22:40:41.467894149 +0000 UTC m=+38.529355557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls") pod "dns-default-5v87q" (UID: "4d8c414b-ec44-4ea6-832c-8f378ce019de") : secret "dns-default-metrics-tls" not found
Jul 30 22:40:40.569080 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.569034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.569301 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:40.569167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:40.569301 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.569216    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 22:40:40.569301 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.569296    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:41.569274791 +0000 UTC m=+38.630736190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : secret "router-metrics-certs-default" not found
Jul 30 22:40:40.569448 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:40.569317    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:41.569306956 +0000 UTC m=+38.630768335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : configmap references non-existent config key: service-ca.crt
Jul 30 22:40:41.464286 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.464235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:40:41.464464 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.464249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:40:41.464524 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.464466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:40:41.467305 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.467268    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 22:40:41.467446 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.467322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 22:40:41.468158 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.468141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-29hrf\""
Jul 30 22:40:41.468363 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.468350    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qzp2k\""
Jul 30 22:40:41.478912 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.478879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:41.479120 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.478989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:41.479120 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.479016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:41.479120 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479050    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479123    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls podName:ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef nodeName:}" failed. No retries permitted until 2026-07-30 22:40:43.479101849 +0000 UTC m=+40.540563227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-vvkps" (UID: "ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef") : secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479128    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479138    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5868bd47d6-274tz: secret "image-registry-tls" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479182    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls podName:c53891e3-2830-4fb9-a938-deb9aab64fed nodeName:}" failed. No retries permitted until 2026-07-30 22:40:43.479166385 +0000 UTC m=+40.540627762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls") pod "image-registry-5868bd47d6-274tz" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed") : secret "image-registry-tls" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479248    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479263    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479280    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert podName:6b9fcb69-990d-4384-8efb-787b257a2e02 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:43.479269934 +0000 UTC m=+40.540731308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8lwtm" (UID: "6b9fcb69-990d-4384-8efb-787b257a2e02") : secret "networking-console-plugin-cert" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.479054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479314    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls podName:4d8c414b-ec44-4ea6-832c-8f378ce019de nodeName:}" failed. No retries permitted until 2026-07-30 22:40:43.47929943 +0000 UTC m=+40.540760808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls") pod "dns-default-5v87q" (UID: "4d8c414b-ec44-4ea6-832c-8f378ce019de") : secret "dns-default-metrics-tls" not found
Jul 30 22:40:41.479503 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.479442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:41.479964 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479603    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 22:40:41.479964 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.479647    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls podName:d7258991-e5c6-4522-84a2-3116b9f8e43b nodeName:}" failed. No retries permitted until 2026-07-30 22:40:43.479633048 +0000 UTC m=+40.541094425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tvzz2" (UID: "d7258991-e5c6-4522-84a2-3116b9f8e43b") : secret "samples-operator-tls" not found
Jul 30 22:40:41.583610 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.580798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:41.583610 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.581220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:41.583610 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.581361    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 22:40:41.583610 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.581411    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:43.581395493 +0000 UTC m=+40.642856867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : secret "router-metrics-certs-default" not found
Jul 30 22:40:41.583610 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:41.582047    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:43.581951165 +0000 UTC m=+40.643412540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : configmap references non-existent config key: service-ca.crt
Jul 30 22:40:41.673937 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.673896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm"]
Jul 30 22:40:41.678545 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.677357    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh"]
Jul 30 22:40:41.678545 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:41.678359    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ac6874_d309_4917_849d_9d5ce7f45d2e.slice/crio-3290d8a3ffbf55b186d5f47f7a76a03511a4e95057bbec272f363bc50088121b WatchSource:0}: Error finding container 3290d8a3ffbf55b186d5f47f7a76a03511a4e95057bbec272f363bc50088121b: Status 404 returned error can't find the container with id 3290d8a3ffbf55b186d5f47f7a76a03511a4e95057bbec272f363bc50088121b
Jul 30 22:40:41.682391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.682314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxx6m"]
Jul 30 22:40:41.684047 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:41.684007    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ba195e_3d52_451c_a332_22b775a0d236.slice/crio-9a2c20ef6f25d2d7f4cdfa981bbe4bfef4dfd86353a63db46ec53507bd3effb8 WatchSource:0}: Error finding container 9a2c20ef6f25d2d7f4cdfa981bbe4bfef4dfd86353a63db46ec53507bd3effb8: Status 404 returned error can't find the container with id 9a2c20ef6f25d2d7f4cdfa981bbe4bfef4dfd86353a63db46ec53507bd3effb8
Jul 30 22:40:41.685327 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:41.685284    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0287a25_f1f5_43f4_8585_7c0d0f3545b1.slice/crio-b77fea38d1f7b39a89c270f767ce6f791fe345117099532f1dc554a30723e5f1 WatchSource:0}: Error finding container b77fea38d1f7b39a89c270f767ce6f791fe345117099532f1dc554a30723e5f1: Status 404 returned error can't find the container with id b77fea38d1f7b39a89c270f767ce6f791fe345117099532f1dc554a30723e5f1
Jul 30 22:40:41.690417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.690397    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv"]
Jul 30 22:40:41.698463 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.697755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-8wrtv"]
Jul 30 22:40:41.698534 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.698505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp"]
Jul 30 22:40:41.703096 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.703052    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-lm6hk"]
Jul 30 22:40:41.722875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.722845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh" event={"ID":"89ba195e-3d52-451c-a332-22b775a0d236","Type":"ContainerStarted","Data":"9a2c20ef6f25d2d7f4cdfa981bbe4bfef4dfd86353a63db46ec53507bd3effb8"}
Jul 30 22:40:41.724051 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.724027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" event={"ID":"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde","Type":"ContainerStarted","Data":"fce6e4eb45c992ee4d02b56d057632fa65c3b95e5bd649ef22938ab40e99180e"}
Jul 30 22:40:41.725896 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.725866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm" event={"ID":"92ac6874-d309-4917-849d-9d5ce7f45d2e","Type":"ContainerStarted","Data":"3290d8a3ffbf55b186d5f47f7a76a03511a4e95057bbec272f363bc50088121b"}
Jul 30 22:40:41.727451 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.727400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxx6m" event={"ID":"f0287a25-f1f5-43f4-8585-7c0d0f3545b1","Type":"ContainerStarted","Data":"b77fea38d1f7b39a89c270f767ce6f791fe345117099532f1dc554a30723e5f1"}
Jul 30 22:40:41.729389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.729364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp" event={"ID":"df296acf-fa13-4131-bffa-9ba389ab759a","Type":"ContainerStarted","Data":"2a3ba52cbfde9047c5b3b9ddfc7a59367cfbdd26709e7ba54a6655190348818c"}
Jul 30 22:40:41.730630 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.730604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8wrtv" event={"ID":"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51","Type":"ContainerStarted","Data":"03a072e0ab74de87493eebf4a67dfd974e6b4d8fc68824f80edb45d0f42e8895"}
Jul 30 22:40:41.731998 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:41.731938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv" event={"ID":"f5ffafa8-d18e-49ef-8438-fb6b87c81825","Type":"ContainerStarted","Data":"523484c55c34a7c27ce938693c8d7e6b67748186d54809ab2aff775426088f03"}
Jul 30 22:40:42.594463 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:42.594277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:42.698906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:42.698850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:42.758203 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:42.758160    2565 generic.go:356] "Generic (PLEG): container finished" podID="f046a693-f7fb-4768-9f0b-2ab613660a9f" containerID="c9f96f92472c2d09c1c4c18ea142df971803c333f07bf37a83d062a77a563b55" exitCode=0
Jul 30 22:40:42.758405 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:42.758216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerDied","Data":"c9f96f92472c2d09c1c4c18ea142df971803c333f07bf37a83d062a77a563b55"}
Jul 30 22:40:42.761550 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:42.761265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:42.829486 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:42.829451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:42.890316 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:42.890096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:43.408043 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.407485    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:43.474830 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.474725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:43.503587 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.502419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:43.503587 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.502479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:43.503587 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.502512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:43.503587 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.502716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:43.503587 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.502849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:43.503587 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.503061    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 22:40:43.503587 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.503127    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls podName:4d8c414b-ec44-4ea6-832c-8f378ce019de nodeName:}" failed. No retries permitted until 2026-07-30 22:40:47.503106687 +0000 UTC m=+44.564568061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls") pod "dns-default-5v87q" (UID: "4d8c414b-ec44-4ea6-832c-8f378ce019de") : secret "dns-default-metrics-tls" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504449    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504535    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert podName:6b9fcb69-990d-4384-8efb-787b257a2e02 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:47.504500629 +0000 UTC m=+44.565962010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8lwtm" (UID: "6b9fcb69-990d-4384-8efb-787b257a2e02") : secret "networking-console-plugin-cert" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504631    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504643    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5868bd47d6-274tz: secret "image-registry-tls" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504698    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls podName:c53891e3-2830-4fb9-a938-deb9aab64fed nodeName:}" failed. No retries permitted until 2026-07-30 22:40:47.504668254 +0000 UTC m=+44.566129645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls") pod "image-registry-5868bd47d6-274tz" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed") : secret "image-registry-tls" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504817    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504889    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls podName:d7258991-e5c6-4522-84a2-3116b9f8e43b nodeName:}" failed. No retries permitted until 2026-07-30 22:40:47.504877116 +0000 UTC m=+44.566338493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tvzz2" (UID: "d7258991-e5c6-4522-84a2-3116b9f8e43b") : secret "samples-operator-tls" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.504965    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:43.505076 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.505024    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls podName:ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef nodeName:}" failed. No retries permitted until 2026-07-30 22:40:47.505010926 +0000 UTC m=+44.566472349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-vvkps" (UID: "ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef") : secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:43.604194 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.604149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:43.604703 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.604298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:43.604703 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.604512    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 22:40:43.604703 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.604596    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:47.604555935 +0000 UTC m=+44.666017310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : secret "router-metrics-certs-default" not found
Jul 30 22:40:43.605186 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:43.605064    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:47.605042535 +0000 UTC m=+44.666503917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : configmap references non-existent config key: service-ca.crt
Jul 30 22:40:43.606629 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.606493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:43.715353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.715234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:43.772612 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.771562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerStarted","Data":"c2982834cd4c44da08c1abc8875e594dc49e69fe97a23f325eb44f1a7e95c3b2"}
Jul 30 22:40:43.951007 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:43.950965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:44.011524 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:44.011340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:44.523442 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:44.523390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:44.623205 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:44.623152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:44.759858 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:44.759819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:44.779117 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:44.779026    2565 generic.go:356] "Generic (PLEG): container finished" podID="f046a693-f7fb-4768-9f0b-2ab613660a9f" containerID="c2982834cd4c44da08c1abc8875e594dc49e69fe97a23f325eb44f1a7e95c3b2" exitCode=0
Jul 30 22:40:44.779117 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:44.779077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerDied","Data":"c2982834cd4c44da08c1abc8875e594dc49e69fe97a23f325eb44f1a7e95c3b2"}
Jul 30 22:40:45.154922 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:45.154883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:45.231293 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:45.231255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:47.545773 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:47.545733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:47.545781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:47.545821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:47.545841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:47.545892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.545933    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.545985    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546011    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls podName:4d8c414b-ec44-4ea6-832c-8f378ce019de nodeName:}" failed. No retries permitted until 2026-07-30 22:40:55.545988229 +0000 UTC m=+52.607449603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls") pod "dns-default-5v87q" (UID: "4d8c414b-ec44-4ea6-832c-8f378ce019de") : secret "dns-default-metrics-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546037    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls podName:ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef nodeName:}" failed. No retries permitted until 2026-07-30 22:40:55.546020865 +0000 UTC m=+52.607482242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-vvkps" (UID: "ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef") : secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546062    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546079    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5868bd47d6-274tz: secret "image-registry-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546081    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546116    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546127    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls podName:c53891e3-2830-4fb9-a938-deb9aab64fed nodeName:}" failed. No retries permitted until 2026-07-30 22:40:55.546112633 +0000 UTC m=+52.607574028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls") pod "image-registry-5868bd47d6-274tz" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed") : secret "image-registry-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546173    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls podName:d7258991-e5c6-4522-84a2-3116b9f8e43b nodeName:}" failed. No retries permitted until 2026-07-30 22:40:55.546159979 +0000 UTC m=+52.607621353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tvzz2" (UID: "d7258991-e5c6-4522-84a2-3116b9f8e43b") : secret "samples-operator-tls" not found
Jul 30 22:40:47.546292 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.546205    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert podName:6b9fcb69-990d-4384-8efb-787b257a2e02 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:55.546194592 +0000 UTC m=+52.607655966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8lwtm" (UID: "6b9fcb69-990d-4384-8efb-787b257a2e02") : secret "networking-console-plugin-cert" not found
Jul 30 22:40:47.647320 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:47.647282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:47.647530 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:47.647384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:47.647622 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.647527    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:55.647502148 +0000 UTC m=+52.708963523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : configmap references non-existent config key: service-ca.crt
Jul 30 22:40:47.647622 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.647541    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 22:40:47.647622 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:47.647614    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:55.6475976 +0000 UTC m=+52.709058984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : secret "router-metrics-certs-default" not found
Jul 30 22:40:49.797028 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.796984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh" event={"ID":"89ba195e-3d52-451c-a332-22b775a0d236","Type":"ContainerStarted","Data":"3322c5524fc8de77d5ef8a04be12bc2a555f58c1297324d551dce50f52c11e2b"}
Jul 30 22:40:49.799796 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.799771    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/0.log"
Jul 30 22:40:49.799958 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.799818    2565 generic.go:356] "Generic (PLEG): container finished" podID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde" containerID="48bc476604009fbc3ea3c50863ba6470c01209e7116148fba471dab81d5aa6dd" exitCode=255
Jul 30 22:40:49.799958 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.799898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" event={"ID":"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde","Type":"ContainerDied","Data":"48bc476604009fbc3ea3c50863ba6470c01209e7116148fba471dab81d5aa6dd"}
Jul 30 22:40:49.800333 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.800313    2565 scope.go:117] "RemoveContainer" containerID="48bc476604009fbc3ea3c50863ba6470c01209e7116148fba471dab81d5aa6dd"
Jul 30 22:40:49.802288 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.801965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm" event={"ID":"92ac6874-d309-4917-849d-9d5ce7f45d2e","Type":"ContainerStarted","Data":"2f626dcf2f8c0a9be25df6b25cd114359ba85b7f4bea45a405c940937e541ce3"}
Jul 30 22:40:49.804746 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.804714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxx6m" event={"ID":"f0287a25-f1f5-43f4-8585-7c0d0f3545b1","Type":"ContainerStarted","Data":"69f44f836677acd048e471508cb9907e8b2734cb665dca5398d6af7433abf427"}
Jul 30 22:40:49.806509 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.806462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp" event={"ID":"df296acf-fa13-4131-bffa-9ba389ab759a","Type":"ContainerStarted","Data":"9464cb5d9133ef1bb1e6b7222dc0e01e1b3b7338ea0b7d50eee869e5f74ac7ce"}
Jul 30 22:40:49.810394 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.810371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" event={"ID":"f046a693-f7fb-4768-9f0b-2ab613660a9f","Type":"ContainerStarted","Data":"52359615bdb648de23c84b5d0812b1b5b6093420ee844644eb235f245cabbc37"}
Jul 30 22:40:49.812449 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.812413    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8wrtv" event={"ID":"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51","Type":"ContainerStarted","Data":"f47510e9cbd722a9b988966f91c81d73e3b5b509686b5b44c8fa539dbb0aff99"}
Jul 30 22:40:49.814362 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.814341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv" event={"ID":"f5ffafa8-d18e-49ef-8438-fb6b87c81825","Type":"ContainerStarted","Data":"d1c68294ebe0f1e72f4a2cd6facb70112c4a0b3ce6ef38086562983b636f694d"}
Jul 30 22:40:49.820097 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.820046    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh" podStartSLOduration=15.088854308 podStartE2EDuration="22.820031206s" totalImagesPullingTime="7.731176898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:49.818004737 +0000 UTC m=+46.879466133" watchObservedRunningTime="2026-07-30 22:40:49.820031206 +0000 UTC m=+46.881492580"
Jul 30 22:40:49.891302 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.891222    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-nhzzm" podStartSLOduration=15.192450581 podStartE2EDuration="22.891203939s" totalImagesPullingTime="7.698753358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:49.890826451 +0000 UTC m=+46.952287850" watchObservedRunningTime="2026-07-30 22:40:49.891203939 +0000 UTC m=+46.952665336"
Jul 30 22:40:49.892024 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.891984    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv" podStartSLOduration=15.172412666 podStartE2EDuration="22.891969543s" totalImagesPullingTime="7.719556877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:49.865703145 +0000 UTC m=+46.927164542" watchObservedRunningTime="2026-07-30 22:40:49.891969543 +0000 UTC m=+46.953430941"
Jul 30 22:40:49.932227 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.932163    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-8wrtv" podStartSLOduration=15.220860507 podStartE2EDuration="22.932141104s" totalImagesPullingTime="7.711280597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:49.911906141 +0000 UTC m=+46.973367538" watchObservedRunningTime="2026-07-30 22:40:49.932141104 +0000 UTC m=+46.993602504"
Jul 30 22:40:49.947914 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.947856    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-hvnsp" podStartSLOduration=15.227136546 podStartE2EDuration="22.947833958s" totalImagesPullingTime="7.720697412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:49.947467192 +0000 UTC m=+47.008928589" watchObservedRunningTime="2026-07-30 22:40:49.947833958 +0000 UTC m=+47.009295355"
Jul 30 22:40:49.964466 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.964408    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nxx6m" podStartSLOduration=3.231941302 podStartE2EDuration="10.964391409s" totalImagesPullingTime="7.732450107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:49.96367439 +0000 UTC m=+47.025135788" watchObservedRunningTime="2026-07-30 22:40:49.964391409 +0000 UTC m=+47.025852807"
Jul 30 22:40:49.985148 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.985087    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kg4kh" podStartSLOduration=12.417352033 podStartE2EDuration="45.985062323s" totalImagesPullingTime="33.56771029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:49.984172354 +0000 UTC m=+47.045633750" watchObservedRunningTime="2026-07-30 22:40:49.985062323 +0000 UTC m=+47.046523718"
Jul 30 22:40:49.992476 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:49.992442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:50.107005 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.106899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:50.151006 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.150965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:50.151194 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.151072    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:40:50.208541 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.208497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:50.764167 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.764087    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jn6rl"]
Jul 30 22:40:50.780139 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.780103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:50.794421 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.794381    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jn6rl"]
Jul 30 22:40:50.794636 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.794521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.797081 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.796838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 22:40:50.797081 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.796873    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9dd4c\""
Jul 30 22:40:50.797081 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.796839    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 22:40:50.820778 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.820748    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/1.log"
Jul 30 22:40:50.821537 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.821503    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/0.log"
Jul 30 22:40:50.821682 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.821553    2565 generic.go:356] "Generic (PLEG): container finished" podID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde" containerID="69de37c8f580865093057915cdbdbb372e212d73b29e8def8d94db3f39b975ce" exitCode=255
Jul 30 22:40:50.822359 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.822339    2565 scope.go:117] "RemoveContainer" containerID="69de37c8f580865093057915cdbdbb372e212d73b29e8def8d94db3f39b975ce"
Jul 30 22:40:50.822546 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:50.822520    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-lm6hk_openshift-console-operator(b716fefc-6f1c-4dfc-a5cd-e74ae8582fde)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" podUID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde"
Jul 30 22:40:50.822802 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.822771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" event={"ID":"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde","Type":"ContainerDied","Data":"69de37c8f580865093057915cdbdbb372e212d73b29e8def8d94db3f39b975ce"}
Jul 30 22:40:50.822900 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.822840    2565 scope.go:117] "RemoveContainer" containerID="48bc476604009fbc3ea3c50863ba6470c01209e7116148fba471dab81d5aa6dd"
Jul 30 22:40:50.852733 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.852555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:50.880960 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.880911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-data-volume\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.881161 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.881100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ngqm\" (UniqueName: \"kubernetes.io/projected/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-api-access-2ngqm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.881217 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.881176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.881322 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.881301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-crio-socket\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.881377 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.881337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.982243 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.982199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-data-volume\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.982463 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.982284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ngqm\" (UniqueName: \"kubernetes.io/projected/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-api-access-2ngqm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.982463 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.982315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.982463 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:50.982457    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:50.982640 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.982488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-crio-socket\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.982640 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.982533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.982640 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:50.982549    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:51.482530199 +0000 UTC m=+48.543991589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:50.982640 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:50.982613    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 22:40:50.982833 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:50.982662    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:51.482644807 +0000 UTC m=+48.544106181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : configmap "kube-rbac-proxy" not found
Jul 30 22:40:50.982833 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.982675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-data-volume\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.982833 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.982716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-crio-socket\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:50.993846 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:50.993810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ngqm\" (UniqueName: \"kubernetes.io/projected/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-api-access-2ngqm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:51.270319 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.270280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.373755 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.373719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.479834 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.479791    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.487913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.487881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:51.488093 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.487947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:51.488093 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:51.488061    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:51.488093 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:51.488082    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 22:40:51.488238 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:51.488144    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:52.488121769 +0000 UTC m=+49.549583143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:51.488238 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:51.488168    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:52.488158082 +0000 UTC m=+49.549619491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : configmap "kube-rbac-proxy" not found
Jul 30 22:40:51.494880 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.494851    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"]
Jul 30 22:40:51.529127 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.529029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"]
Jul 30 22:40:51.529283 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.529175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"
Jul 30 22:40:51.532812 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.531826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 30 22:40:51.532812 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.531953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:51.532812 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.532814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kwddj\""
Jul 30 22:40:51.549536 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.549492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.588905 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.588848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfczl\" (UniqueName: \"kubernetes.io/projected/9e33ab36-72cf-4d79-81fb-88cfd61ed69d-kube-api-access-cfczl\") pod \"migrator-68bc745d87-sz9px\" (UID: \"9e33ab36-72cf-4d79-81fb-88cfd61ed69d\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"
Jul 30 22:40:51.605444 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.605395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.690077 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.690035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfczl\" (UniqueName: \"kubernetes.io/projected/9e33ab36-72cf-4d79-81fb-88cfd61ed69d-kube-api-access-cfczl\") pod \"migrator-68bc745d87-sz9px\" (UID: \"9e33ab36-72cf-4d79-81fb-88cfd61ed69d\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"
Jul 30 22:40:51.699872 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.699838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfczl\" (UniqueName: \"kubernetes.io/projected/9e33ab36-72cf-4d79-81fb-88cfd61ed69d-kube-api-access-cfczl\") pod \"migrator-68bc745d87-sz9px\" (UID: \"9e33ab36-72cf-4d79-81fb-88cfd61ed69d\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"
Jul 30 22:40:51.744640 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.744601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.808311 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.808226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.827292 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.827265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/1.log"
Jul 30 22:40:51.827704 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.827684    2565 scope.go:117] "RemoveContainer" containerID="69de37c8f580865093057915cdbdbb372e212d73b29e8def8d94db3f39b975ce"
Jul 30 22:40:51.827895 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:51.827873    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-lm6hk_openshift-console-operator(b716fefc-6f1c-4dfc-a5cd-e74ae8582fde)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" podUID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde"
Jul 30 22:40:51.841361 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.841323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"
Jul 30 22:40:51.947591 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.947553    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5c5m_51b906bc-8445-4b46-9236-9d66b897c705/dns-node-resolver/0.log"
Jul 30 22:40:51.977307 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.977260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:51.990232 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:51.990196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px"]
Jul 30 22:40:51.994113 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:51.994074    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e33ab36_72cf_4d79_81fb_88cfd61ed69d.slice/crio-14dead1ec4ccf2a70f1d3392f2a663af2dcd6e3d410a5b792edd7e4e852b463e WatchSource:0}: Error finding container 14dead1ec4ccf2a70f1d3392f2a663af2dcd6e3d410a5b792edd7e4e852b463e: Status 404 returned error can't find the container with id 14dead1ec4ccf2a70f1d3392f2a663af2dcd6e3d410a5b792edd7e4e852b463e
Jul 30 22:40:52.077484 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:52.077390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:52.498513 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:52.498471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:52.498725 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:52.498537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:52.498725 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:52.498647    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 22:40:52.498725 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:52.498654    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:52.498725 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:52.498706    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:54.498689297 +0000 UTC m=+51.560150671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : configmap "kube-rbac-proxy" not found
Jul 30 22:40:52.498725 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:52.498719    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:54.498713087 +0000 UTC m=+51.560174462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:52.833497 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:52.833370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px" event={"ID":"9e33ab36-72cf-4d79-81fb-88cfd61ed69d","Type":"ContainerStarted","Data":"14dead1ec4ccf2a70f1d3392f2a663af2dcd6e3d410a5b792edd7e4e852b463e"}
Jul 30 22:40:52.833932 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:52.833811    2565 scope.go:117] "RemoveContainer" containerID="69de37c8f580865093057915cdbdbb372e212d73b29e8def8d94db3f39b975ce"
Jul 30 22:40:52.834005 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:52.833980    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-lm6hk_openshift-console-operator(b716fefc-6f1c-4dfc-a5cd-e74ae8582fde)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" podUID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde"
Jul 30 22:40:52.943638 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:52.943605    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mwcds_8379cc47-c521-4660-9c0d-a40f4e63ea13/node-ca/0.log"
Jul 30 22:40:53.544191 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.544161    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nxx6m_f0287a25-f1f5-43f4-8585-7c0d0f3545b1/serve-healthcheck-canary/0.log"
Jul 30 22:40:53.575675 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.575637    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-w29ww"]
Jul 30 22:40:53.588761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.588729    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-w29ww"]
Jul 30 22:40:53.588942 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.588844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.591248 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.591218    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 30 22:40:53.592273 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.592251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 30 22:40:53.592403 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.592283    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-twltk\""
Jul 30 22:40:53.592403 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.592317    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 30 22:40:53.592403 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.592366    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 30 22:40:53.608454 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.608421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw8w2\" (UniqueName: \"kubernetes.io/projected/148fd0fd-9f3c-49fb-b0b6-13627c180819-kube-api-access-nw8w2\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.608675 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.608504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/148fd0fd-9f3c-49fb-b0b6-13627c180819-signing-cabundle\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.608675 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.608566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/148fd0fd-9f3c-49fb-b0b6-13627c180819-signing-key\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.610196 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.610163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:53.709875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.709842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/148fd0fd-9f3c-49fb-b0b6-13627c180819-signing-cabundle\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.710040 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.709947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/148fd0fd-9f3c-49fb-b0b6-13627c180819-signing-key\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.710116 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.710052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw8w2\" (UniqueName: \"kubernetes.io/projected/148fd0fd-9f3c-49fb-b0b6-13627c180819-kube-api-access-nw8w2\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.710514 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.710490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/148fd0fd-9f3c-49fb-b0b6-13627c180819-signing-cabundle\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.712510 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.712476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/148fd0fd-9f3c-49fb-b0b6-13627c180819-signing-key\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.718286 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.718253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw8w2\" (UniqueName: \"kubernetes.io/projected/148fd0fd-9f3c-49fb-b0b6-13627c180819-kube-api-access-nw8w2\") pod \"service-ca-98c88fbb5-w29ww\" (UID: \"148fd0fd-9f3c-49fb-b0b6-13627c180819\") " pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:53.900198 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:53.900156    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-w29ww"
Jul 30 22:40:54.050964 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.050934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-w29ww"]
Jul 30 22:40:54.053326 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:40:54.053299    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148fd0fd_9f3c_49fb_b0b6_13627c180819.slice/crio-93806e6c6ba8f7d048974df036ab6d3a65926bf7c6605a6def0794153318d24f WatchSource:0}: Error finding container 93806e6c6ba8f7d048974df036ab6d3a65926bf7c6605a6def0794153318d24f: Status 404 returned error can't find the container with id 93806e6c6ba8f7d048974df036ab6d3a65926bf7c6605a6def0794153318d24f
Jul 30 22:40:54.458363 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.458306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:54.516087 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.516041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:54.516267 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.516151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:54.516267 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:54.516235    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:54.516354 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:54.516269    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 22:40:54.516354 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:54.516319    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:58.516298335 +0000 UTC m=+55.577759723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:54.516456 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:54.516393    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:40:58.516383163 +0000 UTC m=+55.577844541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : configmap "kube-rbac-proxy" not found
Jul 30 22:40:54.841638 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.841521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px" event={"ID":"9e33ab36-72cf-4d79-81fb-88cfd61ed69d","Type":"ContainerStarted","Data":"dd33402df7c816d09b1f6a99534e029d4582130786f9940d131a89e562526678"}
Jul 30 22:40:54.841638 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.841608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px" event={"ID":"9e33ab36-72cf-4d79-81fb-88cfd61ed69d","Type":"ContainerStarted","Data":"1ad780d2ce254b062bc4fe7cf2935f8199ca954a3fafa772268cf9611f52ed3f"}
Jul 30 22:40:54.843279 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.843251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-w29ww" event={"ID":"148fd0fd-9f3c-49fb-b0b6-13627c180819","Type":"ContainerStarted","Data":"025c5b571d7372d89627cd52436be0a01cde7f2e7a031e9ffa8bac2339ff68f5"}
Jul 30 22:40:54.843436 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.843302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-w29ww" event={"ID":"148fd0fd-9f3c-49fb-b0b6-13627c180819","Type":"ContainerStarted","Data":"93806e6c6ba8f7d048974df036ab6d3a65926bf7c6605a6def0794153318d24f"}
Jul 30 22:40:54.856692 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.856630    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-sz9px" podStartSLOduration=2.059071007 podStartE2EDuration="3.85661124s" totalImagesPullingTime="1.797540233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:54.85537871 +0000 UTC m=+51.916840117" watchObservedRunningTime="2026-07-30 22:40:54.85661124 +0000 UTC m=+51.918072670"
Jul 30 22:40:54.869471 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:54.869413    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-w29ww" podStartSLOduration=1.869397358 podStartE2EDuration="1.869397358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:54.869315049 +0000 UTC m=+51.930776446" watchObservedRunningTime="2026-07-30 22:40:54.869397358 +0000 UTC m=+51.930858755"
Jul 30 22:40:55.312778 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.312735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:55.415027 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.414977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:55.581818 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.581720    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:55.626352 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.626309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:40:55.626543 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.626365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:40:55.626543 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.626462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:40:55.626543 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626469    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 22:40:55.626543 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626494    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5868bd47d6-274tz: secret "image-registry-tls" not found
Jul 30 22:40:55.626770 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626564    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls podName:c53891e3-2830-4fb9-a938-deb9aab64fed nodeName:}" failed. No retries permitted until 2026-07-30 22:41:11.62653734 +0000 UTC m=+68.687998719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls") pod "image-registry-5868bd47d6-274tz" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed") : secret "image-registry-tls" not found
Jul 30 22:40:55.626770 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.626633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:40:55.626770 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.626675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:40:55.626919 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626638    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:55.626919 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626835    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls podName:ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef nodeName:}" failed. No retries permitted until 2026-07-30 22:41:11.626822841 +0000 UTC m=+68.688284221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-vvkps" (UID: "ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef") : secret "cluster-monitoring-operator-tls" not found
Jul 30 22:40:55.626919 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626904    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 22:40:55.627063 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626937    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert podName:6b9fcb69-990d-4384-8efb-787b257a2e02 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:11.626925541 +0000 UTC m=+68.688386921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8lwtm" (UID: "6b9fcb69-990d-4384-8efb-787b257a2e02") : secret "networking-console-plugin-cert" not found
Jul 30 22:40:55.627063 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626696    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 22:40:55.627063 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626968    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls podName:d7258991-e5c6-4522-84a2-3116b9f8e43b nodeName:}" failed. No retries permitted until 2026-07-30 22:41:11.626959762 +0000 UTC m=+68.688421140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-tvzz2" (UID: "d7258991-e5c6-4522-84a2-3116b9f8e43b") : secret "samples-operator-tls" not found
Jul 30 22:40:55.627063 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626795    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 22:40:55.627063 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.626995    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls podName:4d8c414b-ec44-4ea6-832c-8f378ce019de nodeName:}" failed. No retries permitted until 2026-07-30 22:41:11.626987581 +0000 UTC m=+68.688448975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls") pod "dns-default-5v87q" (UID: "4d8c414b-ec44-4ea6-832c-8f378ce019de") : secret "dns-default-metrics-tls" not found
Jul 30 22:40:55.727690 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.727638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:55.727963 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.727748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:40:55.727963 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.727838    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:11.727814222 +0000 UTC m=+68.789275614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : configmap references non-existent config key: service-ca.crt
Jul 30 22:40:55.727963 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.727903    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 22:40:55.727963 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:55.727953    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs podName:0b021827-5c88-4bb7-8d39-56b0b3f3cb00 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:11.727936465 +0000 UTC m=+68.789397845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs") pod "router-default-7bfdd7b448-4nxrm" (UID: "0b021827-5c88-4bb7-8d39-56b0b3f3cb00") : secret "router-metrics-certs-default" not found
Jul 30 22:40:55.743444 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.743407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:55.846438 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.846341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:55.955044 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:55.954980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:56.043159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:56.043115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:56.408482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:56.408437    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:57.221779 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:57.221739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:57.279518 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:57.279470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:57.620362 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:57.620266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:57.821409 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:57.821371    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:58.216676 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.216630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:58.406196 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.406152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:58.461841 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.461807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:58.555262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.555165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:58.555262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.555254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:58.555462 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:58.555330    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:58.555462 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:40:58.555394    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls podName:f6a4ab7c-97a9-4182-9800-b55e2b98cdfd nodeName:}" failed. No retries permitted until 2026-07-30 22:41:06.555380058 +0000 UTC m=+63.616841431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn6rl" (UID: "f6a4ab7c-97a9-4182-9800-b55e2b98cdfd") : secret "insights-runtime-extractor-tls" not found
Jul 30 22:40:58.555865 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.555844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:40:58.835184 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.835082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:58.934904 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:58.934863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:59.035598 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:59.035544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:59.088733 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:59.088635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:59.220898 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:59.220853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:59.420766 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:59.420728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:59.816171 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:59.816066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:40:59.917013 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:40:59.916974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:00.150619 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.150564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:41:00.150826 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.150661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:41:00.151091 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.151073    2565 scope.go:117] "RemoveContainer" containerID="69de37c8f580865093057915cdbdbb372e212d73b29e8def8d94db3f39b975ce"
Jul 30 22:41:00.314988 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.314952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:00.416848 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.416749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:00.468431 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.468393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:00.527009 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.526964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:00.866212 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.866138    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:41:00.866597 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.866564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/1.log"
Jul 30 22:41:00.866647 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.866625    2565 generic.go:356] "Generic (PLEG): container finished" podID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde" containerID="ae23c3c9c0a114afb153f0fc5601916e07f860f62d255f0675023ef277e0b3fc" exitCode=255
Jul 30 22:41:00.866729 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.866708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" event={"ID":"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde","Type":"ContainerDied","Data":"ae23c3c9c0a114afb153f0fc5601916e07f860f62d255f0675023ef277e0b3fc"}
Jul 30 22:41:00.866781 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.866770    2565 scope.go:117] "RemoveContainer" containerID="69de37c8f580865093057915cdbdbb372e212d73b29e8def8d94db3f39b975ce"
Jul 30 22:41:00.867129 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:00.867107    2565 scope.go:117] "RemoveContainer" containerID="ae23c3c9c0a114afb153f0fc5601916e07f860f62d255f0675023ef277e0b3fc"
Jul 30 22:41:00.867313 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:41:00.867274    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-lm6hk_openshift-console-operator(b716fefc-6f1c-4dfc-a5cd-e74ae8582fde)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" podUID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde"
Jul 30 22:41:01.017482 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.017440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:01.117168 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.117060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:01.218523 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.218485    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:01.319239 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.319199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:01.510664 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.510616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:01.615444 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.615404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:01.814648 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.814541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:01.873081 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:01.873052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:41:02.202723 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:02.202668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:03.013136 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:03.013074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:03.412435 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:03.412394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:03.614278 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:03.614240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:03.888860 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:03.888825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:04.214305 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:04.214215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:05.015200 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:05.015154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:05.216303 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:05.216263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:05.630891 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:05.630851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:05.712215 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:05.712186    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4zlm"
Jul 30 22:41:05.828446 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:05.828386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:06.029749 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:06.029649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:06.637938 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:06.637901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:41:06.640560 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:06.640524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6a4ab7c-97a9-4182-9800-b55e2b98cdfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn6rl\" (UID: \"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd\") " pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:41:06.709948 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:06.709905    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9dd4c\""
Jul 30 22:41:06.717622 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:06.717518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jn6rl"
Jul 30 22:41:06.861450 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:06.861421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jn6rl"]
Jul 30 22:41:06.866149 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:06.866115    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a4ab7c_97a9_4182_9800_b55e2b98cdfd.slice/crio-e04a900a47a15db77249b38f523b4d209fc646c52b35d70c8802224c4d273af9 WatchSource:0}: Error finding container e04a900a47a15db77249b38f523b4d209fc646c52b35d70c8802224c4d273af9: Status 404 returned error can't find the container with id e04a900a47a15db77249b38f523b4d209fc646c52b35d70c8802224c4d273af9
Jul 30 22:41:06.889343 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:06.889233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn6rl" event={"ID":"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd","Type":"ContainerStarted","Data":"e04a900a47a15db77249b38f523b4d209fc646c52b35d70c8802224c4d273af9"}
Jul 30 22:41:07.584302 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:07.584268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:07.894341 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:07.894307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn6rl" event={"ID":"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd","Type":"ContainerStarted","Data":"9f67a82592b8469276f4270aba77e0b0e60b391a0e5a4aeebc12f2a3669ca6e6"}
Jul 30 22:41:07.894512 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:07.894364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn6rl" event={"ID":"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd","Type":"ContainerStarted","Data":"8e5b6c5cffbc7e9ae6309e8139dfe05948e2c50c9552892424f0f66c0dc752ac"}
Jul 30 22:41:08.152862 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.152764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:41:08.153046 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.152870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:41:08.157015 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.156988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 22:41:08.157144 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.157102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 22:41:08.166288 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.166251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8919e466-cff0-4c4f-b85d-b98ca5f4bbe1-original-pull-secret\") pod \"global-pull-secret-syncer-69zk4\" (UID: \"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1\") " pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:41:08.166425 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.166252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b3fce6-25a2-40da-a249-56a8a68ec276-metrics-certs\") pod \"network-metrics-daemon-rfbsc\" (UID: \"32b3fce6-25a2-40da-a249-56a8a68ec276\") " pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:41:08.175271 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.175237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-69zk4"
Jul 30 22:41:08.186156 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.186134    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-29hrf\""
Jul 30 22:41:08.193613 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.193560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfbsc"
Jul 30 22:41:08.253813 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.253727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:41:08.257173 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.257135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zmgc\" (UniqueName: \"kubernetes.io/projected/904a8475-32f4-4b6c-b752-2313b576ef64-kube-api-access-8zmgc\") pod \"network-check-target-t7t4k\" (UID: \"904a8475-32f4-4b6c-b752-2313b576ef64\") " pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:41:08.320410 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.320381    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-69zk4"]
Jul 30 22:41:08.322832 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:08.322800    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8919e466_cff0_4c4f_b85d_b98ca5f4bbe1.slice/crio-e98dbf1eb03752c5335e1576571d9bc495dfe7b61354e33cb56a0cf2916761bf WatchSource:0}: Error finding container e98dbf1eb03752c5335e1576571d9bc495dfe7b61354e33cb56a0cf2916761bf: Status 404 returned error can't find the container with id e98dbf1eb03752c5335e1576571d9bc495dfe7b61354e33cb56a0cf2916761bf
Jul 30 22:41:08.338748 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.338712    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rfbsc"]
Jul 30 22:41:08.341864 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:08.341839    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b3fce6_25a2_40da_a249_56a8a68ec276.slice/crio-c22c728e7439ffc02f22167406f5407936d22ef276ae871e43d34c547ce0b155 WatchSource:0}: Error finding container c22c728e7439ffc02f22167406f5407936d22ef276ae871e43d34c547ce0b155: Status 404 returned error can't find the container with id c22c728e7439ffc02f22167406f5407936d22ef276ae871e43d34c547ce0b155
Jul 30 22:41:08.494966 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.494874    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qzp2k\""
Jul 30 22:41:08.502884 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.502850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:41:08.651026 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.650990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t7t4k"]
Jul 30 22:41:08.654506 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:08.654477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904a8475_32f4_4b6c_b752_2313b576ef64.slice/crio-60ef8d0e04fb69a9ebf52f9b04fc5af2fb3b5e0366ae632fb165b505ccc94ba0 WatchSource:0}: Error finding container 60ef8d0e04fb69a9ebf52f9b04fc5af2fb3b5e0366ae632fb165b505ccc94ba0: Status 404 returned error can't find the container with id 60ef8d0e04fb69a9ebf52f9b04fc5af2fb3b5e0366ae632fb165b505ccc94ba0
Jul 30 22:41:08.901080 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.901031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t7t4k" event={"ID":"904a8475-32f4-4b6c-b752-2313b576ef64","Type":"ContainerStarted","Data":"cf2865258c7e7f65233d40b5b865ea11b8725a573a79d2953e391f3379cb3b65"}
Jul 30 22:41:08.901289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.901153    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:41:08.901289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.901179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t7t4k" event={"ID":"904a8475-32f4-4b6c-b752-2313b576ef64","Type":"ContainerStarted","Data":"60ef8d0e04fb69a9ebf52f9b04fc5af2fb3b5e0366ae632fb165b505ccc94ba0"}
Jul 30 22:41:08.902609 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.902558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rfbsc" event={"ID":"32b3fce6-25a2-40da-a249-56a8a68ec276","Type":"ContainerStarted","Data":"c22c728e7439ffc02f22167406f5407936d22ef276ae871e43d34c547ce0b155"}
Jul 30 22:41:08.904161 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.904127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-69zk4" event={"ID":"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1","Type":"ContainerStarted","Data":"e98dbf1eb03752c5335e1576571d9bc495dfe7b61354e33cb56a0cf2916761bf"}
Jul 30 22:41:08.921071 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:08.921012    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t7t4k" podStartSLOduration=64.920996923 podStartE2EDuration="1m4.920996923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:08.920358179 +0000 UTC m=+65.981819576" watchObservedRunningTime="2026-07-30 22:41:08.920996923 +0000 UTC m=+65.982458297"
Jul 30 22:41:09.911998 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:09.911959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn6rl" event={"ID":"f6a4ab7c-97a9-4182-9800-b55e2b98cdfd","Type":"ContainerStarted","Data":"110affba2ce74b63b9adb914561d1b470bf1cf0a152840b0330ea085d2c99e60"}
Jul 30 22:41:09.914501 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:09.914417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rfbsc" event={"ID":"32b3fce6-25a2-40da-a249-56a8a68ec276","Type":"ContainerStarted","Data":"5a7daa41e7673870a3f38c1bfbd25f044365e635d69c11385f07f1e6232eb618"}
Jul 30 22:41:09.934913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:09.934858    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jn6rl" podStartSLOduration=17.496004713 podStartE2EDuration="19.934838413s" totalImagesPullingTime="2.4388337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:09.933275158 +0000 UTC m=+66.994736556" watchObservedRunningTime="2026-07-30 22:41:09.934838413 +0000 UTC m=+66.996299809"
Jul 30 22:41:10.150799 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:10.150764    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:41:10.150995 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:10.150831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:41:10.151188 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:10.151174    2565 scope.go:117] "RemoveContainer" containerID="ae23c3c9c0a114afb153f0fc5601916e07f860f62d255f0675023ef277e0b3fc"
Jul 30 22:41:10.151359 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:41:10.151330    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-lm6hk_openshift-console-operator(b716fefc-6f1c-4dfc-a5cd-e74ae8582fde)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" podUID="b716fefc-6f1c-4dfc-a5cd-e74ae8582fde"
Jul 30 22:41:10.920471 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:10.920422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rfbsc" event={"ID":"32b3fce6-25a2-40da-a249-56a8a68ec276","Type":"ContainerStarted","Data":"ba9b51ece29b73bef750e9c6df78234551bef6b9dd3532fbe605459157cd6081"}
Jul 30 22:41:10.940984 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:10.940890    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rfbsc" podStartSLOduration=65.55450743 podStartE2EDuration="1m6.940864045s" totalImagesPullingTime="1.386356615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:10.939194562 +0000 UTC m=+68.000655964" watchObservedRunningTime="2026-07-30 22:41:10.940864045 +0000 UTC m=+68.002325443"
Jul 30 22:41:11.689108 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.689053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:41:11.689300 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.689180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:41:11.689300 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.689211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:41:11.689300 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.689239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:41:11.689300 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.689266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:41:11.692530 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.692490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c414b-ec44-4ea6-832c-8f378ce019de-metrics-tls\") pod \"dns-default-5v87q\" (UID: \"4d8c414b-ec44-4ea6-832c-8f378ce019de\") " pod="openshift-dns/dns-default-5v87q"
Jul 30 22:41:11.692530 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.692502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b9fcb69-990d-4384-8efb-787b257a2e02-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8lwtm\" (UID: \"6b9fcb69-990d-4384-8efb-787b257a2e02\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:41:11.692530 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.692510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7258991-e5c6-4522-84a2-3116b9f8e43b-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-tvzz2\" (UID: \"d7258991-e5c6-4522-84a2-3116b9f8e43b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:41:11.692833 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.692718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-vvkps\" (UID: \"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:41:11.694288 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.694262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"image-registry-5868bd47d6-274tz\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") " pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:41:11.789762 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.789722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:11.789948 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.789794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:11.790836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.790810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-service-ca-bundle\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:11.792859 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.792831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b021827-5c88-4bb7-8d39-56b0b3f3cb00-metrics-certs\") pod \"router-default-7bfdd7b448-4nxrm\" (UID: \"0b021827-5c88-4bb7-8d39-56b0b3f3cb00\") " pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:11.854304 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.854268    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f59gl\""
Jul 30 22:41:11.862036 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.862001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:41:11.862763 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.862737    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fxmmh\""
Jul 30 22:41:11.871012 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.870985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"
Jul 30 22:41:11.905920 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.905887    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nvvgp\""
Jul 30 22:41:11.913182 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.913153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"
Jul 30 22:41:11.913330 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.913240    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5xcgf\""
Jul 30 22:41:11.921282 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.921251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"
Jul 30 22:41:11.936085 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.936064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cqmw\""
Jul 30 22:41:11.944779 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.944746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5v87q"
Jul 30 22:41:11.962885 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.962857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4v9q7\""
Jul 30 22:41:11.970301 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:11.970268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:12.820410 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:12.819521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm"]
Jul 30 22:41:12.837065 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:12.835989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2"]
Jul 30 22:41:12.858015 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:12.857973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5v87q"]
Jul 30 22:41:12.880446 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:12.880397    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bfdd7b448-4nxrm"]
Jul 30 22:41:12.882912 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:12.882885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5868bd47d6-274tz"]
Jul 30 22:41:12.905233 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:12.905194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps"]
Jul 30 22:41:12.948120 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:12.948073    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9fcb69_990d_4384_8efb_787b257a2e02.slice/crio-c74742dc81e82132c6b33de7edc3599eca24eee8e3c6fdc7d68829a8d09518cc WatchSource:0}: Error finding container c74742dc81e82132c6b33de7edc3599eca24eee8e3c6fdc7d68829a8d09518cc: Status 404 returned error can't find the container with id c74742dc81e82132c6b33de7edc3599eca24eee8e3c6fdc7d68829a8d09518cc
Jul 30 22:41:12.950368 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:12.950270    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8c414b_ec44_4ea6_832c_8f378ce019de.slice/crio-2fa7d3d4b1628b23dab423e01e01b2fd1ec962d4714b6545f1c329409b01fcaa WatchSource:0}: Error finding container 2fa7d3d4b1628b23dab423e01e01b2fd1ec962d4714b6545f1c329409b01fcaa: Status 404 returned error can't find the container with id 2fa7d3d4b1628b23dab423e01e01b2fd1ec962d4714b6545f1c329409b01fcaa
Jul 30 22:41:12.951676 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:12.951511    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b021827_5c88_4bb7_8d39_56b0b3f3cb00.slice/crio-84aa86427b4a5ec06401de14722e813f10d5c8ec10bc5252ebb68faa96aa7aec WatchSource:0}: Error finding container 84aa86427b4a5ec06401de14722e813f10d5c8ec10bc5252ebb68faa96aa7aec: Status 404 returned error can't find the container with id 84aa86427b4a5ec06401de14722e813f10d5c8ec10bc5252ebb68faa96aa7aec
Jul 30 22:41:12.952015 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:12.951965    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53891e3_2830_4fb9_a938_deb9aab64fed.slice/crio-a58319a3d8c0dee96e1fbcc59b9139e12a4eff171eea72f86c10aecaf81609d3 WatchSource:0}: Error finding container a58319a3d8c0dee96e1fbcc59b9139e12a4eff171eea72f86c10aecaf81609d3: Status 404 returned error can't find the container with id a58319a3d8c0dee96e1fbcc59b9139e12a4eff171eea72f86c10aecaf81609d3
Jul 30 22:41:12.953073 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:12.952945    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4d9cd9_80d1_42ea_85d2_6dd1afd7f1ef.slice/crio-23c037fd944955e2b61d24e813546935c8b311571fd672cc0d5038a19c003b2e WatchSource:0}: Error finding container 23c037fd944955e2b61d24e813546935c8b311571fd672cc0d5038a19c003b2e: Status 404 returned error can't find the container with id 23c037fd944955e2b61d24e813546935c8b311571fd672cc0d5038a19c003b2e
Jul 30 22:41:13.408803 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.408761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:13.467356 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.467260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:13.934851 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.934810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5v87q" event={"ID":"4d8c414b-ec44-4ea6-832c-8f378ce019de","Type":"ContainerStarted","Data":"2fa7d3d4b1628b23dab423e01e01b2fd1ec962d4714b6545f1c329409b01fcaa"}
Jul 30 22:41:13.936613 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.936557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2" event={"ID":"d7258991-e5c6-4522-84a2-3116b9f8e43b","Type":"ContainerStarted","Data":"171500cb0c1adcb1bd0aabf8f0e8e752b9283d613e188430d4a38d9180298024"}
Jul 30 22:41:13.938984 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.938900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm" event={"ID":"0b021827-5c88-4bb7-8d39-56b0b3f3cb00","Type":"ContainerStarted","Data":"b3c28eeb33a22e33a55e52bf60fae28d57d56170a03d6b8c476ade1f57a7df47"}
Jul 30 22:41:13.938984 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.938948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm" event={"ID":"0b021827-5c88-4bb7-8d39-56b0b3f3cb00","Type":"ContainerStarted","Data":"84aa86427b4a5ec06401de14722e813f10d5c8ec10bc5252ebb68faa96aa7aec"}
Jul 30 22:41:13.941276 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.941235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-69zk4" event={"ID":"8919e466-cff0-4c4f-b85d-b98ca5f4bbe1","Type":"ContainerStarted","Data":"f5bda1f1653f1a22be39f63258e18d24be44eaa5dfd0853dade3885f6af89090"}
Jul 30 22:41:13.944643 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.944613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps" event={"ID":"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef","Type":"ContainerStarted","Data":"23c037fd944955e2b61d24e813546935c8b311571fd672cc0d5038a19c003b2e"}
Jul 30 22:41:13.947230 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.947196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5868bd47d6-274tz" event={"ID":"c53891e3-2830-4fb9-a938-deb9aab64fed","Type":"ContainerStarted","Data":"38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42"}
Jul 30 22:41:13.947353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.947252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5868bd47d6-274tz" event={"ID":"c53891e3-2830-4fb9-a938-deb9aab64fed","Type":"ContainerStarted","Data":"a58319a3d8c0dee96e1fbcc59b9139e12a4eff171eea72f86c10aecaf81609d3"}
Jul 30 22:41:13.947842 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.947820    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:41:13.949511 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.949490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm" event={"ID":"6b9fcb69-990d-4384-8efb-787b257a2e02","Type":"ContainerStarted","Data":"c74742dc81e82132c6b33de7edc3599eca24eee8e3c6fdc7d68829a8d09518cc"}
Jul 30 22:41:13.964603 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.963750    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm" podStartSLOduration=46.963728941 podStartE2EDuration="46.963728941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:13.961812346 +0000 UTC m=+71.023273744" watchObservedRunningTime="2026-07-30 22:41:13.963728941 +0000 UTC m=+71.025190338"
Jul 30 22:41:13.970630 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.970600    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:13.974048 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:13.974019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:14.004912 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:14.004857    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-69zk4" podStartSLOduration=65.354512217 podStartE2EDuration="1m10.004839358s" totalImagesPullingTime="4.650327141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:14.003570155 +0000 UTC m=+71.065031553" watchObservedRunningTime="2026-07-30 22:41:14.004839358 +0000 UTC m=+71.066300753"
Jul 30 22:41:14.005119 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:14.004992    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5868bd47d6-274tz" podStartSLOduration=70.004986786 podStartE2EDuration="1m10.004986786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:13.987714501 +0000 UTC m=+71.049175909" watchObservedRunningTime="2026-07-30 22:41:14.004986786 +0000 UTC m=+71.066448181"
Jul 30 22:41:14.953663 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:14.953630    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:14.955522 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:14.955490    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bfdd7b448-4nxrm"
Jul 30 22:41:15.034024 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:15.033984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:15.221597 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:15.221477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:15.308391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:15.308357    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:15.404544 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:15.404506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:16.368815 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.368771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:16.464223 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.464132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:16.526884 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.526846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:16.849933 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.849827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:16.962609 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.962540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps" event={"ID":"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef","Type":"ContainerStarted","Data":"0bceb6e2d701b829b5519418b322602c4d7ff2b72ce995b619eb6be25e97bed8"}
Jul 30 22:41:16.964194 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.964165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm" event={"ID":"6b9fcb69-990d-4384-8efb-787b257a2e02","Type":"ContainerStarted","Data":"a41747314ea485734f5dc5d542388670032c1550782a4f58ff88f408fd97168c"}
Jul 30 22:41:16.966020 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.965995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5v87q" event={"ID":"4d8c414b-ec44-4ea6-832c-8f378ce019de","Type":"ContainerStarted","Data":"bca31a915c5ec9fad384beca110b23a0df43c711fa30d7bf88460fa93b3d7525"}
Jul 30 22:41:16.966178 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.966054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5v87q"
Jul 30 22:41:16.966178 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.966081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5v87q" event={"ID":"4d8c414b-ec44-4ea6-832c-8f378ce019de","Type":"ContainerStarted","Data":"60da2f434e306a052a92bebcbb991850beb685f3c522533e853967c44189b10f"}
Jul 30 22:41:16.967873 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.967844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2" event={"ID":"d7258991-e5c6-4522-84a2-3116b9f8e43b","Type":"ContainerStarted","Data":"2317b7a6fefb8b26566a6ed6b311e2ea14d0494e99e41276c721eabe2addb7e2"}
Jul 30 22:41:16.967992 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.967891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2" event={"ID":"d7258991-e5c6-4522-84a2-3116b9f8e43b","Type":"ContainerStarted","Data":"20f51ce21f2c19926dfa7e0b12f16754ee0034a749d016a55b1c869afb6e6a38"}
Jul 30 22:41:16.979933 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:16.979881    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps" podStartSLOduration=46.96287892 podStartE2EDuration="49.979863103s" totalImagesPullingTime="3.016984183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:16.979040297 +0000 UTC m=+74.040501694" watchObservedRunningTime="2026-07-30 22:41:16.979863103 +0000 UTC m=+74.041324526"
Jul 30 22:41:17.000354 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:17.000298    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5v87q" podStartSLOduration=34.972222743 podStartE2EDuration="38.000279907s" totalImagesPullingTime="3.028057164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:16.999342665 +0000 UTC m=+74.060804062" watchObservedRunningTime="2026-07-30 22:41:17.000279907 +0000 UTC m=+74.061741303"
Jul 30 22:41:17.017948 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:17.017892    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-tvzz2" podStartSLOduration=47.07205502 podStartE2EDuration="50.017869863s" totalImagesPullingTime="2.945814843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:17.017502533 +0000 UTC m=+74.078963930" watchObservedRunningTime="2026-07-30 22:41:17.017869863 +0000 UTC m=+74.079331258"
Jul 30 22:41:17.037859 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:17.037800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8lwtm" podStartSLOduration=47.014322383 podStartE2EDuration="50.037782309s" totalImagesPullingTime="3.023459926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:17.036773042 +0000 UTC m=+74.098234437" watchObservedRunningTime="2026-07-30 22:41:17.037782309 +0000 UTC m=+74.099243705"
Jul 30 22:41:17.174193 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:17.174159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:17.274652 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:17.274617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:20.733222 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:20.733185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:20.833425 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:20.833385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:21.702416 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:21.702375    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:21.777015 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:21.776929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:24.572201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:24.572069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:24.655209 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:24.655179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:24.778383 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:24.778346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:25.468322 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:25.468293    2565 scope.go:117] "RemoveContainer" containerID="ae23c3c9c0a114afb153f0fc5601916e07f860f62d255f0675023ef277e0b3fc"
Jul 30 22:41:26.003800 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.003767    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:41:26.004317 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.003838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" event={"ID":"b716fefc-6f1c-4dfc-a5cd-e74ae8582fde","Type":"ContainerStarted","Data":"5b2feee514e6343dedccc2e0f9cafa715aeb1cbe1a70e65229725eb51adf1df5"}
Jul 30 22:41:26.004317 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.004117    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:41:26.029701 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.029643    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk" podStartSLOduration=51.318843406 podStartE2EDuration="59.029626929s" totalImagesPullingTime="7.710783523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:26.028721787 +0000 UTC m=+83.090183183" watchObservedRunningTime="2026-07-30 22:41:26.029626929 +0000 UTC m=+83.091088324"
Jul 30 22:41:26.036655 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.036614    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-lm6hk"
Jul 30 22:41:26.251247 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.251208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:26.343525 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.343410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:26.528957 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.528918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:26.700451 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.700405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:26.801732 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.801676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:26.901537 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.901474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:26.974033 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.973905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5v87q"
Jul 30 22:41:26.977301 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:26.977238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:27.120904 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:27.120866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:27.740513 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:27.740478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:27.837266 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:27.837228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:27.938180 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:27.938137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:28.040825 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:28.040735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:28.731067 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:28.731007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:28.831985 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:28.831953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:28.933369 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:28.933330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:29.139248 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:29.139183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:29.240233 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:29.240197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:29.741902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:29.741863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:30.020941 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:30.020859    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:41:30.020941 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:30.020901    2565 generic.go:356] "Generic (PLEG): container finished" podID="ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef" containerID="0bceb6e2d701b829b5519418b322602c4d7ff2b72ce995b619eb6be25e97bed8" exitCode=2
Jul 30 22:41:30.021142 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:30.020955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps" event={"ID":"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef","Type":"ContainerDied","Data":"0bceb6e2d701b829b5519418b322602c4d7ff2b72ce995b619eb6be25e97bed8"}
Jul 30 22:41:30.021314 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:30.021299    2565 scope.go:117] "RemoveContainer" containerID="0bceb6e2d701b829b5519418b322602c4d7ff2b72ce995b619eb6be25e97bed8"
Jul 30 22:41:30.186779 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:30.186726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:31.027312 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:31.027277    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:41:31.027846 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:31.027352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-vvkps" event={"ID":"ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef","Type":"ContainerStarted","Data":"942753ae08a8038b20d58e419cb096c3d70a8cc10c1515e154cff38a027914cc"}
Jul 30 22:41:31.866866 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:31.866830    2565 patch_prober.go:28] interesting pod/image-registry-5868bd47d6-274tz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 22:41:31.867048 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:31.866886    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5868bd47d6-274tz" podUID="c53891e3-2830-4fb9-a938-deb9aab64fed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 22:41:33.724670 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.724618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:33.804806 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.804769    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7pp9s"]
Jul 30 22:41:33.807840 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.807819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.811200 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.811149    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 22:41:33.811496 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.811475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 22:41:33.811993 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.811973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-94cf2\""
Jul 30 22:41:33.812101 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.811973    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 22:41:33.812101 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.812026    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 22:41:33.858449 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.858410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:33.869839 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.869804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870047 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.869849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a81e0576-d7e4-4ed0-9708-170d932e9d61-metrics-client-ca\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870047 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.869877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-wtmp\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870047 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.869894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-textfile\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870047 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.869943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-accelerators-collector-config\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870047 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.869986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-root\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870047 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.870034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-tls\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870264 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.870090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-sys\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.870264 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.870119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zks6m\" (UniqueName: \"kubernetes.io/projected/a81e0576-d7e4-4ed0-9708-170d932e9d61-kube-api-access-zks6m\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.954224 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.954184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:33.971359 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a81e0576-d7e4-4ed0-9708-170d932e9d61-metrics-client-ca\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971475 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-wtmp\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971475 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-textfile\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971475 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-accelerators-collector-config\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971475 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-root\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-tls\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-sys\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-root\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zks6m\" (UniqueName: \"kubernetes.io/projected/a81e0576-d7e4-4ed0-9708-170d932e9d61-kube-api-access-zks6m\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-wtmp\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.971707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a81e0576-d7e4-4ed0-9708-170d932e9d61-sys\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.972018 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.971933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-textfile\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.972125 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.972096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a81e0576-d7e4-4ed0-9708-170d932e9d61-metrics-client-ca\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.972262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.972152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-accelerators-collector-config\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.974113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.974082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.974211 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.974181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a81e0576-d7e4-4ed0-9708-170d932e9d61-node-exporter-tls\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:33.980515 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:33.980459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zks6m\" (UniqueName: \"kubernetes.io/projected/a81e0576-d7e4-4ed0-9708-170d932e9d61-kube-api-access-zks6m\") pod \"node-exporter-7pp9s\" (UID: \"a81e0576-d7e4-4ed0-9708-170d932e9d61\") " pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:34.050319 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:34.050281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:34.118492 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:34.118455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7pp9s"
Jul 30 22:41:34.129552 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:34.129507    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81e0576_d7e4_4ed0_9708_170d932e9d61.slice/crio-632023ffa4bf37047b944ae5b9aef447a724ff7f42d34925b3570999c174cf24 WatchSource:0}: Error finding container 632023ffa4bf37047b944ae5b9aef447a724ff7f42d34925b3570999c174cf24: Status 404 returned error can't find the container with id 632023ffa4bf37047b944ae5b9aef447a724ff7f42d34925b3570999c174cf24
Jul 30 22:41:34.151031 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:34.150990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:34.446931 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:34.446895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:34.656241 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:34.656201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:34.754518 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:34.754426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:34.875429 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:34.875395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:35.046715 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:35.046626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pp9s" event={"ID":"a81e0576-d7e4-4ed0-9708-170d932e9d61","Type":"ContainerStarted","Data":"632023ffa4bf37047b944ae5b9aef447a724ff7f42d34925b3570999c174cf24"}
Jul 30 22:41:35.076549 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:35.076515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:35.527162 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:35.527106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:35.633063 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:35.633016    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:35.961038 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:35.960936    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:41:36.052260 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.052215    2565 generic.go:356] "Generic (PLEG): container finished" podID="a81e0576-d7e4-4ed0-9708-170d932e9d61" containerID="39e796d8ab4e744664f0864adaa60b79c7b40e49bf20adac66759a006f7c45f5" exitCode=0
Jul 30 22:41:36.052464 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.052286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pp9s" event={"ID":"a81e0576-d7e4-4ed0-9708-170d932e9d61","Type":"ContainerDied","Data":"39e796d8ab4e744664f0864adaa60b79c7b40e49bf20adac66759a006f7c45f5"}
Jul 30 22:41:36.200127 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.200088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:36.297541 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.297458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:36.566721 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.566636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:36.674677 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.674634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:36.840569 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.840465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:36.946208 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:36.946170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:37.041432 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.041396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:37.058765 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.058732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pp9s" event={"ID":"a81e0576-d7e4-4ed0-9708-170d932e9d61","Type":"ContainerStarted","Data":"0205fe16b375c40460ebaf10942f70b7ae7c8e2780bdb97e5f24bb9dfd1b174c"}
Jul 30 22:41:37.058954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.058789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pp9s" event={"ID":"a81e0576-d7e4-4ed0-9708-170d932e9d61","Type":"ContainerStarted","Data":"2370ca97bf8ce2d944512c74fe321d10f153038c159b7430c18e7026d12a1837"}
Jul 30 22:41:37.090127 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.090071    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7pp9s" podStartSLOduration=2.870292255 podStartE2EDuration="4.090054354s" totalImagesPullingTime="1.144875027s" totalInitContainerRuntime="74.887072ms" isStatefulPod=true podCreationTimestamp="2026-07-30 22:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:37.089289812 +0000 UTC m=+94.150751209" watchObservedRunningTime="2026-07-30 22:41:37.090054354 +0000 UTC m=+94.151515753"
Jul 30 22:41:37.531250 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.531210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:37.630096 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.630057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:37.656456 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.656424    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5868bd47d6-274tz"]
Jul 30 22:41:37.784692 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.784605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:37.884787 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:37.884742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:38.200475 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:38.200423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:38.372261 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:38.372209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:38.521975 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:38.521873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:38.586326 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:38.586290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:38.724947 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:38.724908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:39.395652 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:39.395617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:39.451967 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:39.451927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:39.917662 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:39.917629    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t7t4k"
Jul 30 22:41:40.132746 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.132636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:40.134232 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.134202    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:41:40.137169 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.137143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.139594 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.139546    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 22:41:40.139756 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.139711    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 22:41:40.139819 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.139749    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9hggw\""
Jul 30 22:41:40.140114 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140096    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 22:41:40.140262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140120    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 22:41:40.140262 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140136    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 22:41:40.140472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 22:41:40.140607 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140470    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 22:41:40.140693 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140592    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 22:41:40.140693 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 22:41:40.140802 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 22:41:40.140978 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.140959    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 22:41:40.141268 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.141250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 22:41:40.141371 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.141293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 22:41:40.141371 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.141311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5m13ovifsm90e\""
Jul 30 22:41:40.143380 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.143355    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 22:41:40.147353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.147324    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 22:41:40.163663 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.163616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:41:40.226767 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.226767 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4x8f\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-kube-api-access-t4x8f\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.226991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-config\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.227516 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.227239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328360 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328360 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4x8f\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-kube-api-access-t4x8f\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.328673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-config\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329159 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.328952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.329800 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.329749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.330104 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.330073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.331404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.330456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.331404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.331030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.331868 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.331829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.332025 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.332000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.332650 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.332527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.332650 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.332629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.333391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.332836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.333391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.332952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.333391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.333075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.333659 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.333510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-config\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.334351 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.334300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.334726 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.334612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.334839 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.334816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.335651 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.335621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.336212 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.336185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.336507 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.336485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4x8f\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-kube-api-access-t4x8f\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.336567 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.336514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.449486 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.449434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:40.605079 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:40.605042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:41:40.608290 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:41:40.608261    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80892424_0297_4c6e_9f47_67b7bba75bc3.slice/crio-4d56f3561769bc73a9cd146ac3b9057ad421dbe16fb62cc66779cce20d9f5713 WatchSource:0}: Error finding container 4d56f3561769bc73a9cd146ac3b9057ad421dbe16fb62cc66779cce20d9f5713: Status 404 returned error can't find the container with id 4d56f3561769bc73a9cd146ac3b9057ad421dbe16fb62cc66779cce20d9f5713
Jul 30 22:41:41.078419 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:41.078381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerStarted","Data":"4d56f3561769bc73a9cd146ac3b9057ad421dbe16fb62cc66779cce20d9f5713"}
Jul 30 22:41:41.328500 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:41.328405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:41.386633 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:41.386596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:42.084183 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:42.084139    2565 generic.go:356] "Generic (PLEG): container finished" podID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be" exitCode=0
Jul 30 22:41:42.084623 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:42.084190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"}
Jul 30 22:41:43.412085 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:43.412046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:43.514034 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:43.513997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:44.174198 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:44.174156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:44.273930 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:44.273882    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:45.169179 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:45.169132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:45.272010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:45.271916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:45.372930 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:45.372837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:46.106556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:46.106513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerStarted","Data":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"}
Jul 30 22:41:46.106762 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:46.106670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerStarted","Data":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"}
Jul 30 22:41:48.118499 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:48.118459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerStarted","Data":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"}
Jul 30 22:41:48.118904 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:48.118534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerStarted","Data":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"}
Jul 30 22:41:48.529878 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:48.529833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:48.630966 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:48.630924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:49.125797 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:49.125762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerStarted","Data":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"}
Jul 30 22:41:49.126186 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:49.125832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerStarted","Data":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"}
Jul 30 22:41:49.161562 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:49.161495    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.638312868 podStartE2EDuration="9.161472441s" totalImagesPullingTime="6.503322716s" totalInitContainerRuntime="19.836857ms" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:49.159458009 +0000 UTC m=+106.220919422" watchObservedRunningTime="2026-07-30 22:41:49.161472441 +0000 UTC m=+106.222933840"
Jul 30 22:41:50.449906 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:50.449859    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:41:55.109062 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:55.109014    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:55.226027 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:55.225992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:56.201949 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:56.201904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:56.309536 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:56.309496    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:58.448211 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:58.448170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:58.548877 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:58.548833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:59.163555 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:59.163521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:41:59.256091 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:41:59.256056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:00.211845 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:00.211804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:00.268241 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:00.268202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:01.177524 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:01.177487    2565 generic.go:356] "Generic (PLEG): container finished" podID="89ba195e-3d52-451c-a332-22b775a0d236" containerID="3322c5524fc8de77d5ef8a04be12bc2a555f58c1297324d551dce50f52c11e2b" exitCode=0
Jul 30 22:42:01.177733 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:01.177542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh" event={"ID":"89ba195e-3d52-451c-a332-22b775a0d236","Type":"ContainerDied","Data":"3322c5524fc8de77d5ef8a04be12bc2a555f58c1297324d551dce50f52c11e2b"}
Jul 30 22:42:01.177963 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:01.177946    2565 scope.go:117] "RemoveContainer" containerID="3322c5524fc8de77d5ef8a04be12bc2a555f58c1297324d551dce50f52c11e2b"
Jul 30 22:42:02.183210 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:02.183174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-2d6dh" event={"ID":"89ba195e-3d52-451c-a332-22b775a0d236","Type":"ContainerStarted","Data":"9096bb13429810707c41763dec9d34e2e30e8d886747d2d2b26cb12435f9788e"}
Jul 30 22:42:02.676052 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:02.676012    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5868bd47d6-274tz" podUID="c53891e3-2830-4fb9-a938-deb9aab64fed" containerName="registry" containerID="cri-o://38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42" gracePeriod=30
Jul 30 22:42:02.929275 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:02.929210    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:42:03.038647 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-trusted-ca\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.038845 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c53891e3-2830-4fb9-a938-deb9aab64fed-ca-trust-extracted\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.038845 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038734    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-image-registry-private-configuration\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.038845 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038758    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.038845 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-installation-pull-secrets\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.039049 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038868    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-certificates\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.039049 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038891    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-bound-sa-token\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.039049 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.038942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkjwl\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-kube-api-access-dkjwl\") pod \"c53891e3-2830-4fb9-a938-deb9aab64fed\" (UID: \"c53891e3-2830-4fb9-a938-deb9aab64fed\") "
Jul 30 22:42:03.039199 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.039073    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:03.039388 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.039348    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:03.039388 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.039384    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-trusted-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.041674 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.041627    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:03.042061 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.042024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:03.042178 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.042082    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:03.042275 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.042255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-kube-api-access-dkjwl" (OuterVolumeSpecName: "kube-api-access-dkjwl") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "kube-api-access-dkjwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:03.042326 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.042299    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:03.047147 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.047109    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c53891e3-2830-4fb9-a938-deb9aab64fed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c53891e3-2830-4fb9-a938-deb9aab64fed" (UID: "c53891e3-2830-4fb9-a938-deb9aab64fed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:42:03.140857 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.140811    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-installation-pull-secrets\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.140857 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.140848    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-certificates\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.140857 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.140864    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-bound-sa-token\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.141125 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.140876    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkjwl\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-kube-api-access-dkjwl\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.141125 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.140890    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c53891e3-2830-4fb9-a938-deb9aab64fed-ca-trust-extracted\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.141125 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.140903    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c53891e3-2830-4fb9-a938-deb9aab64fed-image-registry-private-configuration\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.141125 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.140914    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c53891e3-2830-4fb9-a938-deb9aab64fed-registry-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:03.188872 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.188785    2565 generic.go:356] "Generic (PLEG): container finished" podID="c53891e3-2830-4fb9-a938-deb9aab64fed" containerID="38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42" exitCode=0
Jul 30 22:42:03.188872 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.188837    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5868bd47d6-274tz"
Jul 30 22:42:03.188872 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.188854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5868bd47d6-274tz" event={"ID":"c53891e3-2830-4fb9-a938-deb9aab64fed","Type":"ContainerDied","Data":"38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42"}
Jul 30 22:42:03.189395 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.188898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5868bd47d6-274tz" event={"ID":"c53891e3-2830-4fb9-a938-deb9aab64fed","Type":"ContainerDied","Data":"a58319a3d8c0dee96e1fbcc59b9139e12a4eff171eea72f86c10aecaf81609d3"}
Jul 30 22:42:03.189395 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.188918    2565 scope.go:117] "RemoveContainer" containerID="38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42"
Jul 30 22:42:03.198283 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.198261    2565 scope.go:117] "RemoveContainer" containerID="38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42"
Jul 30 22:42:03.198662 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:03.198635    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42\": container with ID starting with 38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42 not found: ID does not exist" containerID="38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42"
Jul 30 22:42:03.198768 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.198671    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42"} err="failed to get container status \"38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42\": rpc error: code = NotFound desc = could not find container \"38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42\": container with ID starting with 38d629cf708f5cf06940573e9345665918025e1147d9a247e936db10ebdc6b42 not found: ID does not exist"
Jul 30 22:42:03.210086 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.210055    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5868bd47d6-274tz"]
Jul 30 22:42:03.218400 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.218364    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5868bd47d6-274tz"]
Jul 30 22:42:03.469338 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:03.469253    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c53891e3-2830-4fb9-a938-deb9aab64fed" path="/var/lib/kubelet/pods/c53891e3-2830-4fb9-a938-deb9aab64fed/volumes"
Jul 30 22:42:05.771260 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:05.771223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:05.875333 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:05.875295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:05.974154 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:05.974122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:11.222203 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:11.222164    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5ffafa8-d18e-49ef-8438-fb6b87c81825" containerID="d1c68294ebe0f1e72f4a2cd6facb70112c4a0b3ce6ef38086562983b636f694d" exitCode=0
Jul 30 22:42:11.222643 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:11.222241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv" event={"ID":"f5ffafa8-d18e-49ef-8438-fb6b87c81825","Type":"ContainerDied","Data":"d1c68294ebe0f1e72f4a2cd6facb70112c4a0b3ce6ef38086562983b636f694d"}
Jul 30 22:42:11.222643 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:11.222588    2565 scope.go:117] "RemoveContainer" containerID="d1c68294ebe0f1e72f4a2cd6facb70112c4a0b3ce6ef38086562983b636f694d"
Jul 30 22:42:12.228558 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:12.228524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-nl7fv" event={"ID":"f5ffafa8-d18e-49ef-8438-fb6b87c81825","Type":"ContainerStarted","Data":"50d47b353a3863aee2e0ac10827d3a275823b87a29fd6f35877bed48a78b2b63"}
Jul 30 22:42:13.403246 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:13.403208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:13.470469 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:13.470435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:20.261782 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:20.261749    2565 generic.go:356] "Generic (PLEG): container finished" podID="5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51" containerID="f47510e9cbd722a9b988966f91c81d73e3b5b509686b5b44c8fa539dbb0aff99" exitCode=0
Jul 30 22:42:20.262187 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:20.261819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8wrtv" event={"ID":"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51","Type":"ContainerDied","Data":"f47510e9cbd722a9b988966f91c81d73e3b5b509686b5b44c8fa539dbb0aff99"}
Jul 30 22:42:20.262187 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:20.262174    2565 scope.go:117] "RemoveContainer" containerID="f47510e9cbd722a9b988966f91c81d73e3b5b509686b5b44c8fa539dbb0aff99"
Jul 30 22:42:21.268676 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:21.268637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8wrtv" event={"ID":"5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51","Type":"ContainerStarted","Data":"9d51471cb71e5729f9ad583abbb027c660bb18d599448c84b1473bb088f5d2a5"}
Jul 30 22:42:28.406324 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:28.406279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:28.467131 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:28.467097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:40.450353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:40.450294    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:40.467804 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:40.467776    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:41.375213 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:41.375182    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:53.165059 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:53.165004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:53.375001 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:53.374951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:57.933487 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:57.933405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:42:58.590648 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.590610    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:42:58.590973 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.590944    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="thanos-sidecar" containerID="cri-o://294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1" gracePeriod=600
Jul 30 22:42:58.591051 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.590941    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy" containerID="cri-o://d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e" gracePeriod=600
Jul 30 22:42:58.591107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.591057    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="config-reloader" containerID="cri-o://2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621" gracePeriod=600
Jul 30 22:42:58.591158 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.591105    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="prometheus" containerID="cri-o://0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84" gracePeriod=600
Jul 30 22:42:58.592169 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.591756    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-web" containerID="cri-o://776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0" gracePeriod=600
Jul 30 22:42:58.592169 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.591796    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74" gracePeriod=600
Jul 30 22:42:58.850836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.850753    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:58.925907 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.925864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-serving-certs-ca-bundle\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926111 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.925921    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-db\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926111 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.925943    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-grpc-tls\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926111 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.925967    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-2\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926111 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926002    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-web-config\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926318 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926133    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-thanos-prometheus-http-client-file\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926318 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926188    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4x8f\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-kube-api-access-t4x8f\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926318 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926242    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-tls\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926318 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926311    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926517 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:58.926517 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926367    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-config-out\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926517 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926375    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:58.926517 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-1\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926517 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926456    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.926517 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-trusted-ca-bundle\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-kubelet-serving-ca-bundle\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-tls-assets\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926617    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-metrics-client-certs\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926652    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-0\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926703    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-metrics-client-ca\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-config\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.926775    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-kube-rbac-proxy\") pod \"80892424-0297-4c6e-9f47-67b7bba75bc3\" (UID: \"80892424-0297-4c6e-9f47-67b7bba75bc3\") "
Jul 30 22:42:58.927398 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.927368    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:58.927740 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.927705    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:42:58.928055 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.928027    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:58.929289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.928400    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:58.929289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.928725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:58.929289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929061    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:58.929289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929126    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:58.929289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929143    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-db\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:58.929289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929161    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:58.929289 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.929695 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929322    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.929695 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929384    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-kube-api-access-t4x8f" (OuterVolumeSpecName: "kube-api-access-t4x8f") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "kube-api-access-t4x8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:58.929844 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.929817    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.930369 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.930340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:58.930994 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.930966    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.931751 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.931726    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.931926 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.931905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-config-out" (OuterVolumeSpecName: "config-out") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:42:58.932198 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.932180    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:58.932496 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.932471    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-config" (OuterVolumeSpecName: "config") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.932636 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.932616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.932744 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.932721    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:58.943204 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:58.943159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-web-config" (OuterVolumeSpecName: "web-config") pod "80892424-0297-4c6e-9f47-67b7bba75bc3" (UID: "80892424-0297-4c6e-9f47-67b7bba75bc3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:59.029886 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029843    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.029886 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029879    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-configmap-metrics-client-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.029886 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029891    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-config\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029903    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-kube-rbac-proxy\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029911    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-grpc-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029919    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-web-config\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029928    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029936    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4x8f\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-kube-api-access-t4x8f\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029945    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029954    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029963    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80892424-0297-4c6e-9f47-67b7bba75bc3-config-out\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029971    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029979    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029988    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80892424-0297-4c6e-9f47-67b7bba75bc3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.029996    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80892424-0297-4c6e-9f47-67b7bba75bc3-tls-assets\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.030113 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.030005    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80892424-0297-4c6e-9f47-67b7bba75bc3-secret-metrics-client-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:42:59.434439 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434397    2565 generic.go:356] "Generic (PLEG): container finished" podID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74" exitCode=0
Jul 30 22:42:59.434439 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434426    2565 generic.go:356] "Generic (PLEG): container finished" podID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e" exitCode=0
Jul 30 22:42:59.434439 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434433    2565 generic.go:356] "Generic (PLEG): container finished" podID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0" exitCode=0
Jul 30 22:42:59.434439 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434439    2565 generic.go:356] "Generic (PLEG): container finished" podID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1" exitCode=0
Jul 30 22:42:59.434439 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434444    2565 generic.go:356] "Generic (PLEG): container finished" podID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621" exitCode=0
Jul 30 22:42:59.434439 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434449    2565 generic.go:356] "Generic (PLEG): container finished" podID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84" exitCode=0
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"}
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434515    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"}
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"}
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"}
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"}
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"}
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434665    2565 scope.go:117] "RemoveContainer" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.434943 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.434746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80892424-0297-4c6e-9f47-67b7bba75bc3","Type":"ContainerDied","Data":"4d56f3561769bc73a9cd146ac3b9057ad421dbe16fb62cc66779cce20d9f5713"}
Jul 30 22:42:59.443832 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.443812    2565 scope.go:117] "RemoveContainer" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.453390 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.453359    2565 scope.go:117] "RemoveContainer" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.459327 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.459298    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:42:59.463469 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.463437    2565 scope.go:117] "RemoveContainer" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.468419 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.468392    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:42:59.472259 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.472232    2565 scope.go:117] "RemoveContainer" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.480084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.480063    2565 scope.go:117] "RemoveContainer" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.489314 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489104    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489307    2565 scope.go:117] "RemoveContainer" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489413    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-web"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489425    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-web"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489437    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="thanos-sidecar"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489443    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="thanos-sidecar"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489456    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-thanos"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489462    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-thanos"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489468    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c53891e3-2830-4fb9-a938-deb9aab64fed" containerName="registry"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489474    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c53891e3-2830-4fb9-a938-deb9aab64fed" containerName="registry"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489481    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="prometheus"
Jul 30 22:42:59.489483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489486    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="prometheus"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489494    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489499    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489506    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="init-config-reloader"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489514    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="init-config-reloader"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489522    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="config-reloader"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489529    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="config-reloader"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489614    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-web"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489628    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c53891e3-2830-4fb9-a938-deb9aab64fed" containerName="registry"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489635    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="thanos-sidecar"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489643    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy-thanos"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489651    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="kube-rbac-proxy"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489661    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="config-reloader"
Jul 30 22:42:59.489875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.489668    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" containerName="prometheus"
Jul 30 22:42:59.495228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.495196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.498085 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498057    2565 scope.go:117] "RemoveContainer" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.498248 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 22:42:59.498313 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498241    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 22:42:59.498313 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498239    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 22:42:59.498420 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 22:42:59.498640 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:59.498618    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": container with ID starting with 9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74 not found: ID does not exist" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.498745 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498655    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"} err="failed to get container status \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": rpc error: code = NotFound desc = could not find container \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": container with ID starting with 9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74 not found: ID does not exist"
Jul 30 22:42:59.498745 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498683    2565 scope.go:117] "RemoveContainer" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.498859 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498624    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 22:42:59.498859 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498755    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 22:42:59.498859 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 22:42:59.498859 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498780    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 22:42:59.498859 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.498755    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 22:42:59.499096 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:59.499007    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": container with ID starting with d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e not found: ID does not exist" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.499096 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499034    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"} err="failed to get container status \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": rpc error: code = NotFound desc = could not find container \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": container with ID starting with d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e not found: ID does not exist"
Jul 30 22:42:59.499096 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499056    2565 scope.go:117] "RemoveContainer" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.499240 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9hggw\""
Jul 30 22:42:59.499240 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499145    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 22:42:59.499400 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 22:42:59.499449 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:59.499413    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": container with ID starting with 776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0 not found: ID does not exist" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.499498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499452    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"} err="failed to get container status \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": rpc error: code = NotFound desc = could not find container \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": container with ID starting with 776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0 not found: ID does not exist"
Jul 30 22:42:59.499498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499473    2565 scope.go:117] "RemoveContainer" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.499605 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499537    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 22:42:59.499662 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5m13ovifsm90e\""
Jul 30 22:42:59.499721 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499667    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 22:42:59.499912 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:59.499887    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": container with ID starting with 294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1 not found: ID does not exist" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.500008 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499920    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"} err="failed to get container status \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": rpc error: code = NotFound desc = could not find container \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": container with ID starting with 294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1 not found: ID does not exist"
Jul 30 22:42:59.500008 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.499941    2565 scope.go:117] "RemoveContainer" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.500312 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:59.500286    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": container with ID starting with 2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621 not found: ID does not exist" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.500405 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.500320    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"} err="failed to get container status \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": rpc error: code = NotFound desc = could not find container \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": container with ID starting with 2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621 not found: ID does not exist"
Jul 30 22:42:59.500405 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.500343    2565 scope.go:117] "RemoveContainer" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.500725 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:59.500701    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": container with ID starting with 0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84 not found: ID does not exist" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.500795 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.500733    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"} err="failed to get container status \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": rpc error: code = NotFound desc = could not find container \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": container with ID starting with 0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84 not found: ID does not exist"
Jul 30 22:42:59.500795 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.500749    2565 scope.go:117] "RemoveContainer" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.501070 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:42:59.501044    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": container with ID starting with 1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be not found: ID does not exist" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.501141 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.501087    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"} err="failed to get container status \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": rpc error: code = NotFound desc = could not find container \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": container with ID starting with 1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be not found: ID does not exist"
Jul 30 22:42:59.501141 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.501110    2565 scope.go:117] "RemoveContainer" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.501418 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.501391    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"} err="failed to get container status \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": rpc error: code = NotFound desc = could not find container \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": container with ID starting with 9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74 not found: ID does not exist"
Jul 30 22:42:59.501502 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.501420    2565 scope.go:117] "RemoveContainer" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.501756 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.501732    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"} err="failed to get container status \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": rpc error: code = NotFound desc = could not find container \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": container with ID starting with d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e not found: ID does not exist"
Jul 30 22:42:59.501756 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.501755    2565 scope.go:117] "RemoveContainer" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.502028 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502009    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"} err="failed to get container status \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": rpc error: code = NotFound desc = could not find container \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": container with ID starting with 776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0 not found: ID does not exist"
Jul 30 22:42:59.502028 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502028    2565 scope.go:117] "RemoveContainer" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.502233 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502212    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 22:42:59.502324 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502283    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"} err="failed to get container status \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": rpc error: code = NotFound desc = could not find container \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": container with ID starting with 294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1 not found: ID does not exist"
Jul 30 22:42:59.502399 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502326    2565 scope.go:117] "RemoveContainer" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.502640 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502614    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"} err="failed to get container status \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": rpc error: code = NotFound desc = could not find container \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": container with ID starting with 2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621 not found: ID does not exist"
Jul 30 22:42:59.502728 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502644    2565 scope.go:117] "RemoveContainer" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.502928 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502907    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"} err="failed to get container status \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": rpc error: code = NotFound desc = could not find container \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": container with ID starting with 0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84 not found: ID does not exist"
Jul 30 22:42:59.502986 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.502946    2565 scope.go:117] "RemoveContainer" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.503219 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.503194    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"} err="failed to get container status \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": rpc error: code = NotFound desc = could not find container \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": container with ID starting with 1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be not found: ID does not exist"
Jul 30 22:42:59.503284 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.503222    2565 scope.go:117] "RemoveContainer" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.503469 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.503449    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"} err="failed to get container status \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": rpc error: code = NotFound desc = could not find container \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": container with ID starting with 9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74 not found: ID does not exist"
Jul 30 22:42:59.503535 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.503471    2565 scope.go:117] "RemoveContainer" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.503821 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.503771    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"} err="failed to get container status \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": rpc error: code = NotFound desc = could not find container \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": container with ID starting with d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e not found: ID does not exist"
Jul 30 22:42:59.503821 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.503794    2565 scope.go:117] "RemoveContainer" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.504147 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504119    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"} err="failed to get container status \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": rpc error: code = NotFound desc = could not find container \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": container with ID starting with 776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0 not found: ID does not exist"
Jul 30 22:42:59.504147 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504146    2565 scope.go:117] "RemoveContainer" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.504421 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504392    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"} err="failed to get container status \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": rpc error: code = NotFound desc = could not find container \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": container with ID starting with 294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1 not found: ID does not exist"
Jul 30 22:42:59.504507 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504421    2565 scope.go:117] "RemoveContainer" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.504723 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504701    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"} err="failed to get container status \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": rpc error: code = NotFound desc = could not find container \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": container with ID starting with 2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621 not found: ID does not exist"
Jul 30 22:42:59.504804 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504723    2565 scope.go:117] "RemoveContainer" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.504997 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504977    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"} err="failed to get container status \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": rpc error: code = NotFound desc = could not find container \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": container with ID starting with 0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84 not found: ID does not exist"
Jul 30 22:42:59.505064 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.504997    2565 scope.go:117] "RemoveContainer" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.505244 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505227    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"} err="failed to get container status \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": rpc error: code = NotFound desc = could not find container \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": container with ID starting with 1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be not found: ID does not exist"
Jul 30 22:42:59.505244 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505243    2565 scope.go:117] "RemoveContainer" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.505372 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505282    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 22:42:59.505437 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505414    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"} err="failed to get container status \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": rpc error: code = NotFound desc = could not find container \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": container with ID starting with 9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74 not found: ID does not exist"
Jul 30 22:42:59.505494 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505438    2565 scope.go:117] "RemoveContainer" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.505693 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505673    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"} err="failed to get container status \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": rpc error: code = NotFound desc = could not find container \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": container with ID starting with d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e not found: ID does not exist"
Jul 30 22:42:59.505693 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505690    2565 scope.go:117] "RemoveContainer" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.505992 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505965    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"} err="failed to get container status \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": rpc error: code = NotFound desc = could not find container \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": container with ID starting with 776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0 not found: ID does not exist"
Jul 30 22:42:59.506090 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.505993    2565 scope.go:117] "RemoveContainer" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.506278 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.506248    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"} err="failed to get container status \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": rpc error: code = NotFound desc = could not find container \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": container with ID starting with 294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1 not found: ID does not exist"
Jul 30 22:42:59.506278 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.506273    2565 scope.go:117] "RemoveContainer" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.506633 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.506611    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"} err="failed to get container status \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": rpc error: code = NotFound desc = could not find container \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": container with ID starting with 2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621 not found: ID does not exist"
Jul 30 22:42:59.506745 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.506635    2565 scope.go:117] "RemoveContainer" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.506941 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.506889    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"} err="failed to get container status \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": rpc error: code = NotFound desc = could not find container \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": container with ID starting with 0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84 not found: ID does not exist"
Jul 30 22:42:59.506941 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.506924    2565 scope.go:117] "RemoveContainer" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.507194 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.507167    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"} err="failed to get container status \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": rpc error: code = NotFound desc = could not find container \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": container with ID starting with 1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be not found: ID does not exist"
Jul 30 22:42:59.507194 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.507193    2565 scope.go:117] "RemoveContainer" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.507506 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.507483    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"} err="failed to get container status \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": rpc error: code = NotFound desc = could not find container \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": container with ID starting with 9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74 not found: ID does not exist"
Jul 30 22:42:59.507629 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.507508    2565 scope.go:117] "RemoveContainer" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.507839 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.507813    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"} err="failed to get container status \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": rpc error: code = NotFound desc = could not find container \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": container with ID starting with d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e not found: ID does not exist"
Jul 30 22:42:59.507839 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.507839    2565 scope.go:117] "RemoveContainer" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.508151 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508126    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"} err="failed to get container status \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": rpc error: code = NotFound desc = could not find container \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": container with ID starting with 776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0 not found: ID does not exist"
Jul 30 22:42:59.508241 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508153    2565 scope.go:117] "RemoveContainer" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.508428 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508408    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"} err="failed to get container status \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": rpc error: code = NotFound desc = could not find container \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": container with ID starting with 294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1 not found: ID does not exist"
Jul 30 22:42:59.508490 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508429    2565 scope.go:117] "RemoveContainer" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.508687 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508662    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"} err="failed to get container status \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": rpc error: code = NotFound desc = could not find container \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": container with ID starting with 2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621 not found: ID does not exist"
Jul 30 22:42:59.508687 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508687    2565 scope.go:117] "RemoveContainer" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.508945 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508921    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"} err="failed to get container status \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": rpc error: code = NotFound desc = could not find container \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": container with ID starting with 0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84 not found: ID does not exist"
Jul 30 22:42:59.509008 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.508946    2565 scope.go:117] "RemoveContainer" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.509054 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:42:59.509175 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509157    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"} err="failed to get container status \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": rpc error: code = NotFound desc = could not find container \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": container with ID starting with 1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be not found: ID does not exist"
Jul 30 22:42:59.509230 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509174    2565 scope.go:117] "RemoveContainer" containerID="9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"
Jul 30 22:42:59.509392 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509375    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74"} err="failed to get container status \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": rpc error: code = NotFound desc = could not find container \"9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74\": container with ID starting with 9e9111898600c1f934bfa775c8ece4ff64907f6b5ce5604ca5e556171e2bbc74 not found: ID does not exist"
Jul 30 22:42:59.509451 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509392    2565 scope.go:117] "RemoveContainer" containerID="d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"
Jul 30 22:42:59.509625 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509605    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e"} err="failed to get container status \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": rpc error: code = NotFound desc = could not find container \"d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e\": container with ID starting with d419f5ed3232bebd7548a066ecaad833687202022159dc5c66506dd1ed31f36e not found: ID does not exist"
Jul 30 22:42:59.509683 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509625    2565 scope.go:117] "RemoveContainer" containerID="776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"
Jul 30 22:42:59.509815 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509799    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0"} err="failed to get container status \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": rpc error: code = NotFound desc = could not find container \"776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0\": container with ID starting with 776f5f3c2e2969145708122b603fd640dc1fcde3a53e7d99eb74e5e309e843c0 not found: ID does not exist"
Jul 30 22:42:59.509875 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509815    2565 scope.go:117] "RemoveContainer" containerID="294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"
Jul 30 22:42:59.509994 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509977    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1"} err="failed to get container status \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": rpc error: code = NotFound desc = could not find container \"294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1\": container with ID starting with 294e9eeb277aa43d60b33aa32a82a9e54f3ae748ceb1fa9acbe6f2274612dce1 not found: ID does not exist"
Jul 30 22:42:59.509994 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.509993    2565 scope.go:117] "RemoveContainer" containerID="2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"
Jul 30 22:42:59.510230 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.510211    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621"} err="failed to get container status \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": rpc error: code = NotFound desc = could not find container \"2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621\": container with ID starting with 2ff03c2e54e717d5c19f35421c9cee3bc3340c5654b562c55611475c2c723621 not found: ID does not exist"
Jul 30 22:42:59.510230 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.510229    2565 scope.go:117] "RemoveContainer" containerID="0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"
Jul 30 22:42:59.510423 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.510405    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84"} err="failed to get container status \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": rpc error: code = NotFound desc = could not find container \"0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84\": container with ID starting with 0007c3c7fe6e24c7a1071b5bc78a523adf67181e832c17c090ce71dd1c31ef84 not found: ID does not exist"
Jul 30 22:42:59.510423 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.510421    2565 scope.go:117] "RemoveContainer" containerID="1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"
Jul 30 22:42:59.510707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.510677    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be"} err="failed to get container status \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": rpc error: code = NotFound desc = could not find container \"1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be\": container with ID starting with 1f29ca567eb728394a8af63cc5e3bff1da0fc231291d6c44dcea04aeaa64a2be not found: ID does not exist"
Jul 30 22:42:59.635041 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.634994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hldd\" (UniqueName: \"kubernetes.io/projected/8722f322-cf43-40c6-9fc2-1c364f14b7fd-kube-api-access-9hldd\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635041 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-config\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635231 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635231 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8722f322-cf43-40c6-9fc2-1c364f14b7fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635231 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635231 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635231 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635231 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635231 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8722f322-cf43-40c6-9fc2-1c364f14b7fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.635843 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.635478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736461 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736461 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736461 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736461 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hldd\" (UniqueName: \"kubernetes.io/projected/8722f322-cf43-40c6-9fc2-1c364f14b7fd-kube-api-access-9hldd\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-config\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8722f322-cf43-40c6-9fc2-1c364f14b7fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.736854 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.737658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.737658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.737658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.736951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8722f322-cf43-40c6-9fc2-1c364f14b7fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.737658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.737213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.737658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.737346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.737658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.737349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.737658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.737516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.738248 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.738218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.740165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.740164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-config\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.740286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.740661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.740678    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.740751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8722f322-cf43-40c6-9fc2-1c364f14b7fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.740754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8722f322-cf43-40c6-9fc2-1c364f14b7fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.741176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.741258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.741220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.742443 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.742424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8722f322-cf43-40c6-9fc2-1c364f14b7fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.743237 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.743198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.743422 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.743399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.743608 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.743568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.743659 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.743628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8722f322-cf43-40c6-9fc2-1c364f14b7fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.745111 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.745094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hldd\" (UniqueName: \"kubernetes.io/projected/8722f322-cf43-40c6-9fc2-1c364f14b7fd-kube-api-access-9hldd\") pod \"prometheus-k8s-0\" (UID: \"8722f322-cf43-40c6-9fc2-1c364f14b7fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.808133 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.808079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:42:59.971000 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:42:59.970967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:42:59.972461 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:42:59.972420    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8722f322_cf43_40c6_9fc2_1c364f14b7fd.slice/crio-ebfc4af63eee437085bd2b7d36a602da050d8399d633622ddbb9ac87ed829923 WatchSource:0}: Error finding container ebfc4af63eee437085bd2b7d36a602da050d8399d633622ddbb9ac87ed829923: Status 404 returned error can't find the container with id ebfc4af63eee437085bd2b7d36a602da050d8399d633622ddbb9ac87ed829923
Jul 30 22:43:00.440162 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:00.440119    2565 generic.go:356] "Generic (PLEG): container finished" podID="8722f322-cf43-40c6-9fc2-1c364f14b7fd" containerID="b0d42b3b92d994fc6f0837783ebee98e0a443346ed955c7ae4be8f11f590e393" exitCode=0
Jul 30 22:43:00.440319 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:00.440211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerDied","Data":"b0d42b3b92d994fc6f0837783ebee98e0a443346ed955c7ae4be8f11f590e393"}
Jul 30 22:43:00.440319 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:00.440289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerStarted","Data":"ebfc4af63eee437085bd2b7d36a602da050d8399d633622ddbb9ac87ed829923"}
Jul 30 22:43:01.414041 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.413994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:01.449819 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.449775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerStarted","Data":"8c3029114606f572799b77c8c290b743e48041c75eaa592517fe9a715067d5ac"}
Jul 30 22:43:01.449995 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.449886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerStarted","Data":"7bb487a871befafd0a55ac727c57ac5b7f14f89475be8ee0f1a5375f448087ac"}
Jul 30 22:43:01.449995 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.449917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerStarted","Data":"83fefeee198e9ff9dcd81b00c2ea43c152ac6a4eb7e8ca505fc8c394d18e6ae6"}
Jul 30 22:43:01.449995 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.449942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerStarted","Data":"8ee96779529bcb46f165bec3b25827bb0181361526d0558cd29978ef1e2d7dde"}
Jul 30 22:43:01.449995 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.449974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerStarted","Data":"b287d2717a9276b204f506b7241d1f1fd04e9d1291e45be8778f10025863650f"}
Jul 30 22:43:01.449995 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.449997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8722f322-cf43-40c6-9fc2-1c364f14b7fd","Type":"ContainerStarted","Data":"e5e0d8765c89d37b015cb1cfc0d6eba819e4576c559ee4095fb3a9739f128e4b"}
Jul 30 22:43:01.468101 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.468060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:01.470366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.470336    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80892424-0297-4c6e-9f47-67b7bba75bc3" path="/var/lib/kubelet/pods/80892424-0297-4c6e-9f47-67b7bba75bc3/volumes"
Jul 30 22:43:01.476684 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:01.476632    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4569898390000002 podStartE2EDuration="2.47661247s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.622631ms" isStatefulPod=false podCreationTimestamp="2026-07-30 22:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:43:01.474589995 +0000 UTC m=+178.536051383" watchObservedRunningTime="2026-07-30 22:43:01.47661247 +0000 UTC m=+178.538073867"
Jul 30 22:43:04.808266 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:04.808225    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:43:12.489135 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:12.489085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:12.590290 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:12.590248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:12.691082 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:12.691037    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:35.548405 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:35.548363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:40.016821 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:40.016776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:40.069005 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:40.068971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:50.981823 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:50.981787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:51.049227 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:51.049187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:43:59.808681 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:59.808626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:43:59.825945 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:43:59.825905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:44:00.707602 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:00.707554    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:44:08.424285 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:08.424239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:08.480266 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:08.480227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:14.903758 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:14.903717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:15.004556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:15.004516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:15.105778 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:15.105740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:15.643569 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:15.643535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:20.308132 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:20.308088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:20.408987 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:20.408921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:25.750802 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:25.750710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:25.814088 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:25.814043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:25.866349 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:25.866308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:28.409207 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:28.409167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:28.509770 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:28.509729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:28.668970 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:28.668875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:28.733915 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:28.733880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:55.771404 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:55.771364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:44:55.872784 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:44:55.872751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:03.360122 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:03.360086    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:45:03.365386 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:03.365362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:45:03.366750 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:03.366722    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:45:03.373185 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:03.373159    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:45:03.375542 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:03.375515    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:45:03.380383 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:03.380354    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:45:03.380651 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:03.380634    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 22:45:17.378201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:17.378155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:18.986189 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:18.986149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:21.003430 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:21.003384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:21.105198 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:21.105147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:22.305796 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:22.305756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:22.433300 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:22.433255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:22.591276 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:22.591177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:22.692349 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:22.692308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:24.953035 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:24.952997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:25.192536 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:25.192494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:27.776313 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:27.776274    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:27.840996 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:27.840958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:31.948707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:31.948665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:32.007297 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:32.007255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:32.759594 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:32.759539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:35.983046 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:35.982999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:36.084162 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:36.084105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:42.214644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:42.214569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:42.312914 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:42.312883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:44.109064 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:44.109020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:58.985377 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:58.985281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:59.082321 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.082281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:59.624692 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.624645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:59.811012 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.810972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:59.918136 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.918099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:45:59.969086 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.969048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"]
Jul 30 22:45:59.972554 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.972531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:45:59.975922 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.975890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/de9cdb52-cb8e-4e34-ae4f-73207868e06f-manifests\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:45:59.976059 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.975929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9cdb52-cb8e-4e34-ae4f-73207868e06f-tmp\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:45:59.976059 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.975953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxtqs\" (UniqueName: \"kubernetes.io/projected/de9cdb52-cb8e-4e34-ae4f-73207868e06f-kube-api-access-gxtqs\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:45:59.976135 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.976052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/de9cdb52-cb8e-4e34-ae4f-73207868e06f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:45:59.976135 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.976118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de9cdb52-cb8e-4e34-ae4f-73207868e06f-webhook-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:45:59.976327 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.976309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 22:45:59.976677 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.976657    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 22:45:59.976780 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.976679    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 22:45:59.976780 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.976690    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jzx8w\""
Jul 30 22:45:59.976780 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.976696    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 22:45:59.986295 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:45:59.986257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"]
Jul 30 22:46:00.076636 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.076534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/de9cdb52-cb8e-4e34-ae4f-73207868e06f-manifests\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.076636 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.076572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9cdb52-cb8e-4e34-ae4f-73207868e06f-tmp\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.076636 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.076622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxtqs\" (UniqueName: \"kubernetes.io/projected/de9cdb52-cb8e-4e34-ae4f-73207868e06f-kube-api-access-gxtqs\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.076974 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.076668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/de9cdb52-cb8e-4e34-ae4f-73207868e06f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.076974 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.076707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de9cdb52-cb8e-4e34-ae4f-73207868e06f-webhook-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.077075 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.077013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/de9cdb52-cb8e-4e34-ae4f-73207868e06f-manifests\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.079366 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.079330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9cdb52-cb8e-4e34-ae4f-73207868e06f-tmp\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.079504 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.079435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/de9cdb52-cb8e-4e34-ae4f-73207868e06f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.079504 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.079455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de9cdb52-cb8e-4e34-ae4f-73207868e06f-webhook-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.102110 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.102076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxtqs\" (UniqueName: \"kubernetes.io/projected/de9cdb52-cb8e-4e34-ae4f-73207868e06f-kube-api-access-gxtqs\") pod \"opendatahub-operator-controller-manager-ff8c5f475-v9w86\" (UID: \"de9cdb52-cb8e-4e34-ae4f-73207868e06f\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.167506 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.167462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:00.267169 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.267076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:00.284107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.284064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:00.367658 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.367614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:00.433095 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.433057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"]
Jul 30 22:46:00.436648 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:46:00.436610    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9cdb52_cb8e_4e34_ae4f_73207868e06f.slice/crio-c5eeee2bbb5896573207be7ada9e27f594c97eb52b31edace2297a7ec4107f0c WatchSource:0}: Error finding container c5eeee2bbb5896573207be7ada9e27f594c97eb52b31edace2297a7ec4107f0c: Status 404 returned error can't find the container with id c5eeee2bbb5896573207be7ada9e27f594c97eb52b31edace2297a7ec4107f0c
Jul 30 22:46:00.438495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.438476    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:46:00.469492 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.469446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:00.572740 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.572648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:00.668356 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:00.668312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:01.185124 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:01.185083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86" event={"ID":"de9cdb52-cb8e-4e34-ae4f-73207868e06f","Type":"ContainerStarted","Data":"c5eeee2bbb5896573207be7ada9e27f594c97eb52b31edace2297a7ec4107f0c"}
Jul 30 22:46:02.371878 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:02.371830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:02.490594 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:02.490541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:04.200263 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:04.200211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86" event={"ID":"de9cdb52-cb8e-4e34-ae4f-73207868e06f","Type":"ContainerStarted","Data":"24e8fa5144c3c709ca3379fd6fc43b4367c87299460b82ad717e42bb79f34e03"}
Jul 30 22:46:05.206219 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:05.206183    2565 generic.go:356] "Generic (PLEG): container finished" podID="de9cdb52-cb8e-4e34-ae4f-73207868e06f" containerID="24e8fa5144c3c709ca3379fd6fc43b4367c87299460b82ad717e42bb79f34e03" exitCode=0
Jul 30 22:46:05.206652 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:05.206226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86" event={"ID":"de9cdb52-cb8e-4e34-ae4f-73207868e06f","Type":"ContainerDied","Data":"24e8fa5144c3c709ca3379fd6fc43b4367c87299460b82ad717e42bb79f34e03"}
Jul 30 22:46:06.213149 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:06.213105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86" event={"ID":"de9cdb52-cb8e-4e34-ae4f-73207868e06f","Type":"ContainerStarted","Data":"84463f72f529de415b0dc6d5b12c279a9dffeef0ee7f16aecb8fda6cbe4556d4"}
Jul 30 22:46:06.213568 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:06.213221    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:06.237833 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:06.237778    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86" podStartSLOduration=2.508259264 podStartE2EDuration="7.237759252s" totalImagesPullingTime="3.664967784s" totalInitContainerRuntime="1.064532204s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:45:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:06.234290701 +0000 UTC m=+363.295752096" watchObservedRunningTime="2026-07-30 22:46:06.237759252 +0000 UTC m=+363.299220647"
Jul 30 22:46:17.220143 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:17.220109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-v9w86"
Jul 30 22:46:19.293331 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:19.293296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:19.412632 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:19.412562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:19.815526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:19.815478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:20.051949 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:20.051869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:20.184009 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:20.183969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:20.285325 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:20.285279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:21.197528 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:21.197491    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:21.365258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:21.365215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:21.469849 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:21.469758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:21.566314 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:21.566277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:22.285322 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:22.285264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:26.956934 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:26.956893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:27.075828 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.075792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:27.357625 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.357502    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"]
Jul 30 22:46:27.360747 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.360720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.364365 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.364340    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k5zm7\""
Jul 30 22:46:27.364544 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.364340    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 22:46:27.364544 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.364413    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:46:27.364544 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.364461    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 22:46:27.364544 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.364508    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 22:46:27.364783 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.364560    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 22:46:27.372856 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.372814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"]
Jul 30 22:46:27.429785 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.429742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95738e84-2f5e-441d-910e-fdcd21b155a1-manager-config\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.430036 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.429807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95738e84-2f5e-441d-910e-fdcd21b155a1-cert\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.430036 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.429906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmwxd\" (UniqueName: \"kubernetes.io/projected/95738e84-2f5e-441d-910e-fdcd21b155a1-kube-api-access-tmwxd\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.430036 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.429987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95738e84-2f5e-441d-910e-fdcd21b155a1-metrics-cert\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.530894 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.530852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95738e84-2f5e-441d-910e-fdcd21b155a1-cert\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.531085 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.530921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmwxd\" (UniqueName: \"kubernetes.io/projected/95738e84-2f5e-441d-910e-fdcd21b155a1-kube-api-access-tmwxd\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.531085 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.530957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95738e84-2f5e-441d-910e-fdcd21b155a1-metrics-cert\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.531085 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.530990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95738e84-2f5e-441d-910e-fdcd21b155a1-manager-config\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.531634 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.531614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95738e84-2f5e-441d-910e-fdcd21b155a1-manager-config\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.533707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.533683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95738e84-2f5e-441d-910e-fdcd21b155a1-cert\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.533707 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.533701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95738e84-2f5e-441d-910e-fdcd21b155a1-metrics-cert\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.543659 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.543622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmwxd\" (UniqueName: \"kubernetes.io/projected/95738e84-2f5e-441d-910e-fdcd21b155a1-kube-api-access-tmwxd\") pod \"lws-controller-manager-6c6cc5589b-89wkt\" (UID: \"95738e84-2f5e-441d-910e-fdcd21b155a1\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.671251 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.671214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:27.769325 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.767925    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"]
Jul 30 22:46:27.771644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.771615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.774273 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.774246    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z5sl2\""
Jul 30 22:46:27.774918 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.774895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 22:46:27.786228 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.786189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"]
Jul 30 22:46:27.799833 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.799797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:27.824725 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.824522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"]
Jul 30 22:46:27.827612 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:46:27.827560    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95738e84_2f5e_441d_910e_fdcd21b155a1.slice/crio-12eebd239f4c65e30c56b38d0bcec0e9e11970f8edd650937f9bb4d744f0f72d WatchSource:0}: Error finding container 12eebd239f4c65e30c56b38d0bcec0e9e11970f8edd650937f9bb4d744f0f72d: Status 404 returned error can't find the container with id 12eebd239f4c65e30c56b38d0bcec0e9e11970f8edd650937f9bb4d744f0f72d
Jul 30 22:46:27.924408 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.924321    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"]
Jul 30 22:46:27.927527 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.927499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:27.930170 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.930147    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 30 22:46:27.930350 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.930146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 30 22:46:27.930428 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.930409    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 30 22:46:27.930484 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.930449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9cvtl\""
Jul 30 22:46:27.935084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.934961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935084 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935267 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935267 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935267 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935267 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db910a28-28dd-4b79-a8ce-f3488116ef4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935473 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x58zs\" (UniqueName: \"kubernetes.io/projected/db910a28-28dd-4b79-a8ce-f3488116ef4a-kube-api-access-x58zs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935473 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935336    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.935473 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.935359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:27.940785 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.940756    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"]
Jul 30 22:46:27.980311 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:27.980273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:28.036891 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.036843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.036891 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.036886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0212f185-d409-4b4c-a0e4-8c69fb58baf8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.037107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.036917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.036975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.037107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db910a28-28dd-4b79-a8ce-f3488116ef4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x58zs\" (UniqueName: \"kubernetes.io/projected/db910a28-28dd-4b79-a8ce-f3488116ef4a-kube-api-access-x58zs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtp4v\" (UniqueName: \"kubernetes.io/projected/0212f185-d409-4b4c-a0e4-8c69fb58baf8-kube-api-access-rtp4v\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.037353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.037353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.037556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.037556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037946 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037946 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037946 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037946 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db910a28-28dd-4b79-a8ce-f3488116ef4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.037946 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.037889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.038216 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.038011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.039495 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.039472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.039634 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.039621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.050230 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.050202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db910a28-28dd-4b79-a8ce-f3488116ef4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.050397 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.050377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x58zs\" (UniqueName: \"kubernetes.io/projected/db910a28-28dd-4b79-a8ce-f3488116ef4a-kube-api-access-x58zs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t\" (UID: \"db910a28-28dd-4b79-a8ce-f3488116ef4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.090647 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.090612    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:28.090937 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.090914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:28.138478 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.138437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.138666 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.138489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.138666 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.138612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.139061 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.138728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.139061 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.138756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0212f185-d409-4b4c-a0e4-8c69fb58baf8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.139061 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.138807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.139061 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.138861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtp4v\" (UniqueName: \"kubernetes.io/projected/0212f185-d409-4b4c-a0e4-8c69fb58baf8-kube-api-access-rtp4v\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.139754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.139714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.142296 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.142155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0212f185-d409-4b4c-a0e4-8c69fb58baf8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.142546 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.142512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.142863 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.142785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.142863 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.142848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.152864 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.152781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0212f185-d409-4b4c-a0e4-8c69fb58baf8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.160919 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.160884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtp4v\" (UniqueName: \"kubernetes.io/projected/0212f185-d409-4b4c-a0e4-8c69fb58baf8-kube-api-access-rtp4v\") pod \"istiod-openshift-gateway-5677ccb49b-v2fqr\" (UID: \"0212f185-d409-4b4c-a0e4-8c69fb58baf8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.238016 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.237971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:28.240683 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.240650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"]
Jul 30 22:46:28.243610 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:46:28.243554    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb910a28_28dd_4b79_a8ce_f3488116ef4a.slice/crio-136d4e6b5854c04ebd422746519a14e3cc58529adf60ff0ca4bca59f09684ee1 WatchSource:0}: Error finding container 136d4e6b5854c04ebd422746519a14e3cc58529adf60ff0ca4bca59f09684ee1: Status 404 returned error can't find the container with id 136d4e6b5854c04ebd422746519a14e3cc58529adf60ff0ca4bca59f09684ee1
Jul 30 22:46:28.322873 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.322831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t" event={"ID":"db910a28-28dd-4b79-a8ce-f3488116ef4a","Type":"ContainerStarted","Data":"136d4e6b5854c04ebd422746519a14e3cc58529adf60ff0ca4bca59f09684ee1"}
Jul 30 22:46:28.324165 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.324135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt" event={"ID":"95738e84-2f5e-441d-910e-fdcd21b155a1","Type":"ContainerStarted","Data":"12eebd239f4c65e30c56b38d0bcec0e9e11970f8edd650937f9bb4d744f0f72d"}
Jul 30 22:46:28.400370 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:28.400169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"]
Jul 30 22:46:29.332325 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:29.332227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr" event={"ID":"0212f185-d409-4b4c-a0e4-8c69fb58baf8","Type":"ContainerStarted","Data":"4b4e0ad139047e14dbf88871aba8ce7ae12f2c1cca96865541491ab79535ce3d"}
Jul 30 22:46:30.519430 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:30.519370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:30.621018 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:30.620857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:30.724067 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:30.724029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:30.841013 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:30.840924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:31.783122 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:31.783030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:31.894193 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:31.894155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:31.997749 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:31.997712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:32.945529 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:32.945448    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:46:32.946038 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:32.945570    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:46:32.953032 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:32.952989    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:46:32.953115 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:32.953096    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:46:32.953166 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:32.953149    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:46:33.357554 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.357427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr" event={"ID":"0212f185-d409-4b4c-a0e4-8c69fb58baf8","Type":"ContainerStarted","Data":"783c9f780e2380ab26c98083ad2f10e7f580f413d44f77e52b63a154a20d23fd"}
Jul 30 22:46:33.357554 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.357491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:33.359809 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.359774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t" event={"ID":"db910a28-28dd-4b79-a8ce-f3488116ef4a","Type":"ContainerStarted","Data":"745d0aecff9751605873819bfad14d68c519499b2c09dfd6a80cdcb280e72f0a"}
Jul 30 22:46:33.363948 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.363903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt" event={"ID":"95738e84-2f5e-441d-910e-fdcd21b155a1","Type":"ContainerStarted","Data":"224e0364818599561808cb6b47b122eee857492b42aa6a2ff9735bf4b648807b"}
Jul 30 22:46:33.364166 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.364104    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:33.379620 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.379538    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr" podStartSLOduration=1.8427530399999998 podStartE2EDuration="6.379503681s" totalImagesPullingTime="4.536750641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:33.377229758 +0000 UTC m=+390.438691155" watchObservedRunningTime="2026-07-30 22:46:33.379503681 +0000 UTC m=+390.440965058"
Jul 30 22:46:33.395982 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.395924    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt" podStartSLOduration=1.276538994 podStartE2EDuration="6.395905302s" totalImagesPullingTime="5.119366308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:33.394870575 +0000 UTC m=+390.456331974" watchObservedRunningTime="2026-07-30 22:46:33.395905302 +0000 UTC m=+390.457366698"
Jul 30 22:46:33.414754 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:33.414678    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t" podStartSLOduration=1.7085978069999999 podStartE2EDuration="6.41465831s" totalImagesPullingTime="4.706060503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:33.413938224 +0000 UTC m=+390.475399642" watchObservedRunningTime="2026-07-30 22:46:33.41465831 +0000 UTC m=+390.476119709"
Jul 30 22:46:34.091564 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:34.091527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:34.096249 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:34.096218    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:34.369417 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:34.369317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:34.370556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:34.370532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t"
Jul 30 22:46:34.371062 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:34.371043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v2fqr"
Jul 30 22:46:34.917681 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:34.917647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:42.345890 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:42.345846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:42.442752 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:42.442713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:42.542764 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:42.542717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:43.101045 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:43.101003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:43.204197 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:43.204163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:44.371541 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:44.371509    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-89wkt"
Jul 30 22:46:51.230421 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:51.230385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:51.333070 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:51.333023    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:53.179434 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:53.179378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:53.246062 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:53.246028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:53.558414 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:53.558329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:53.657510 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:53.657475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:46:53.759022 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:46:53.758983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:21.045461 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:21.045412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:21.149150 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:21.149095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:32.811355 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:32.811270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:33.624568 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:33.624527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:36.831225 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:36.831171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:37.100811 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:37.100715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:39.032102 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:39.032041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:39.279878 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:39.279835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:41.032299 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:41.032252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:41.419802 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:41.419764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:41.678058 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:41.677964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:41.856599 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:41.856523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:43.076052 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:43.076012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:43.183232 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:43.183197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:45.752852 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:45.752809    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:45.855425 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:45.855393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:45.952406 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:45.952360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:49.625661 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:49.625613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:49.727280 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:49.727240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:51.920419 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:51.920380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:52.048339 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:52.048295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:52.631285 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:52.631233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:52.734836 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:52.734800    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:58.204244 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:58.204201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:58.303998 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:58.303964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:47:58.407375 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:47:58.407337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:06.286785 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:06.286750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:06.386815 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:06.386778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:06.880248 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:06.880194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:06.961913 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:06.961872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:10.279057 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:10.279019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:10.379761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:10.379722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:12.469245 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:12.469206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:12.570731 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:12.570689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:15.001134 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:15.001067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:15.101309 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:15.101273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:18.286201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:18.286158    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:18.387489 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:18.387444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:18.529408 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:18.529340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:26.224049 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:26.224012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:26.285981 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:26.285942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.635500 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.635456    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"]
Jul 30 22:48:31.637986 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.637959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.640561 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.640530    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tlltr\""
Jul 30 22:48:31.649939 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.649906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"]
Jul 30 22:48:31.661507 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.661455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.760545 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.760773 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.760773 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.760773 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.760773 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qjrq\" (UniqueName: \"kubernetes.io/projected/422acd91-ea21-4b8d-8f7e-c30b80403284-kube-api-access-2qjrq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.760928 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.760928 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/422acd91-ea21-4b8d-8f7e-c30b80403284-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.760928 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.761024 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.760947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.861810 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.861768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.861810 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.861809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/422acd91-ea21-4b8d-8f7e-c30b80403284-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862079 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.861838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862079 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.861853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862079 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.861872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862079 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.861896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862308 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.862262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862367 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.862321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862367 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.862336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862478 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.862396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862478 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.862442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjrq\" (UniqueName: \"kubernetes.io/projected/422acd91-ea21-4b8d-8f7e-c30b80403284-kube-api-access-2qjrq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862607 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.862594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/422acd91-ea21-4b8d-8f7e-c30b80403284-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.862974 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.862951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.863061 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.863032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.864529 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.864502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.865278 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.865257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.870552 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.870520    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/422acd91-ea21-4b8d-8f7e-c30b80403284-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.874302 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.874273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qjrq\" (UniqueName: \"kubernetes.io/projected/422acd91-ea21-4b8d-8f7e-c30b80403284-kube-api-access-2qjrq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4p5gj\" (UID: \"422acd91-ea21-4b8d-8f7e-c30b80403284\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:31.917042 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.916942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.949801 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:31.949764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:32.099291 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.099260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"]
Jul 30 22:48:32.101831 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:48:32.101794    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422acd91_ea21_4b8d_8f7e_c30b80403284.slice/crio-341e0812d9c84f165b87e99913be59f5b998f6c11bd5361a847ba3dd8ab11318 WatchSource:0}: Error finding container 341e0812d9c84f165b87e99913be59f5b998f6c11bd5361a847ba3dd8ab11318: Status 404 returned error can't find the container with id 341e0812d9c84f165b87e99913be59f5b998f6c11bd5361a847ba3dd8ab11318
Jul 30 22:48:32.103889 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.103854    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:48:32.103982 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.103924    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:48:32.103982 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.103951    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:48:32.897646 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.897600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" event={"ID":"422acd91-ea21-4b8d-8f7e-c30b80403284","Type":"ContainerStarted","Data":"4d3eaf69f39881f0e32b99a75019cae430ca3c2a9847b5219f9df19bcef8a3d3"}
Jul 30 22:48:32.898058 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.897686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" event={"ID":"422acd91-ea21-4b8d-8f7e-c30b80403284","Type":"ContainerStarted","Data":"341e0812d9c84f165b87e99913be59f5b998f6c11bd5361a847ba3dd8ab11318"}
Jul 30 22:48:32.920729 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.920666    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" podStartSLOduration=1.920648147 podStartE2EDuration="1.920648147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:32.918201332 +0000 UTC m=+509.979662729" watchObservedRunningTime="2026-07-30 22:48:32.920648147 +0000 UTC m=+509.982109543"
Jul 30 22:48:32.950391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:32.950352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:33.955858 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:33.955827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:34.907447 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:34.907415    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:34.908409 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:34.908384    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:48:43.730353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:43.730318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.826105 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:43.826073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.906673 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:43.906632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:44.667276 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:44.667238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:44.765147 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:48:44.765101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:00.483883 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:00.483796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:00.584982 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:00.584939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:01.058775 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:01.058732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:13.785236 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:13.785191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:13.891170 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:13.891129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:13.986849 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:13.986810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:21.456908 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.456862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:21.630192 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.630153    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c7b5c47b4-lr9xt"]
Jul 30 22:49:21.632803 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.632774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:21.638598 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.638545    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-985p9\""
Jul 30 22:49:21.638782 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.638597    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 22:49:21.638984 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.638965    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 22:49:21.639233 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.639056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:21.649826 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.649784    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c7b5c47b4-lr9xt"]
Jul 30 22:49:21.710282 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.710173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert\") pod \"maas-controller-6c7b5c47b4-lr9xt\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") " pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:21.710282 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.710261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9mv\" (UniqueName: \"kubernetes.io/projected/a015858f-a588-4c84-9df5-7a6cde7f9f03-kube-api-access-xf9mv\") pod \"maas-controller-6c7b5c47b4-lr9xt\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") " pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:21.726771 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.726728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:21.803526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.803489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:21.811647 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.811598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert\") pod \"maas-controller-6c7b5c47b4-lr9xt\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") " pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:21.811800 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.811696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9mv\" (UniqueName: \"kubernetes.io/projected/a015858f-a588-4c84-9df5-7a6cde7f9f03-kube-api-access-xf9mv\") pod \"maas-controller-6c7b5c47b4-lr9xt\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") " pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:21.811800 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:49:21.811745    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 30 22:49:21.811877 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:49:21.811835    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert podName:a015858f-a588-4c84-9df5-7a6cde7f9f03 nodeName:}" failed. No retries permitted until 2026-07-30 22:49:22.311814067 +0000 UTC m=+559.373275444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert") pod "maas-controller-6c7b5c47b4-lr9xt" (UID: "a015858f-a588-4c84-9df5-7a6cde7f9f03") : secret "maas-controller-webhook-cert" not found
Jul 30 22:49:21.824527 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.824492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9mv\" (UniqueName: \"kubernetes.io/projected/a015858f-a588-4c84-9df5-7a6cde7f9f03-kube-api-access-xf9mv\") pod \"maas-controller-6c7b5c47b4-lr9xt\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") " pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:21.843962 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.843925    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f7477f447-5s52r"]
Jul 30 22:49:21.846130 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.846111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:21.866204 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.866160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7477f447-5s52r"]
Jul 30 22:49:21.912223 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.912179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr65f\" (UniqueName: \"kubernetes.io/projected/2b0ad847-6c65-413d-b5b8-73f5e5df0800-kube-api-access-hr65f\") pod \"maas-controller-f7477f447-5s52r\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") " pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:21.912412 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:21.912268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b0ad847-6c65-413d-b5b8-73f5e5df0800-webhook-cert\") pod \"maas-controller-f7477f447-5s52r\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") " pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:22.004825 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.004726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:22.013882 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.013843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr65f\" (UniqueName: \"kubernetes.io/projected/2b0ad847-6c65-413d-b5b8-73f5e5df0800-kube-api-access-hr65f\") pod \"maas-controller-f7477f447-5s52r\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") " pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:22.014083 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.013912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b0ad847-6c65-413d-b5b8-73f5e5df0800-webhook-cert\") pod \"maas-controller-f7477f447-5s52r\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") " pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:22.016680 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.016652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b0ad847-6c65-413d-b5b8-73f5e5df0800-webhook-cert\") pod \"maas-controller-f7477f447-5s52r\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") " pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:22.023182 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.023153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr65f\" (UniqueName: \"kubernetes.io/projected/2b0ad847-6c65-413d-b5b8-73f5e5df0800-kube-api-access-hr65f\") pod \"maas-controller-f7477f447-5s52r\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") " pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:22.157357 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.157313    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:22.306736 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.306698    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7477f447-5s52r"]
Jul 30 22:49:22.310008 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:49:22.309981    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0ad847_6c65_413d_b5b8_73f5e5df0800.slice/crio-1d7449c374b2590fc5ce79594ff14bed476cb86a2a4881619f91c26835626c4d WatchSource:0}: Error finding container 1d7449c374b2590fc5ce79594ff14bed476cb86a2a4881619f91c26835626c4d: Status 404 returned error can't find the container with id 1d7449c374b2590fc5ce79594ff14bed476cb86a2a4881619f91c26835626c4d
Jul 30 22:49:22.317119 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.317091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert\") pod \"maas-controller-6c7b5c47b4-lr9xt\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") " pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:22.319900 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.319872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert\") pod \"maas-controller-6c7b5c47b4-lr9xt\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") " pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:22.546883 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.546844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:22.690993 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:22.690963    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c7b5c47b4-lr9xt"]
Jul 30 22:49:22.693281 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:49:22.693251    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda015858f_a588_4c84_9df5_7a6cde7f9f03.slice/crio-d969b394ed6d788f1d4e456c860aa4a4171afef387d5aa5ecf77039192b2bc0f WatchSource:0}: Error finding container d969b394ed6d788f1d4e456c860aa4a4171afef387d5aa5ecf77039192b2bc0f: Status 404 returned error can't find the container with id d969b394ed6d788f1d4e456c860aa4a4171afef387d5aa5ecf77039192b2bc0f
Jul 30 22:49:23.129568 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:23.129509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-5s52r" event={"ID":"2b0ad847-6c65-413d-b5b8-73f5e5df0800","Type":"ContainerStarted","Data":"1d7449c374b2590fc5ce79594ff14bed476cb86a2a4881619f91c26835626c4d"}
Jul 30 22:49:23.130935 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:23.130898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt" event={"ID":"a015858f-a588-4c84-9df5-7a6cde7f9f03","Type":"ContainerStarted","Data":"d969b394ed6d788f1d4e456c860aa4a4171afef387d5aa5ecf77039192b2bc0f"}
Jul 30 22:49:25.005652 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.005561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:25.103669 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.103562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:25.144326 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.143731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-5s52r" event={"ID":"2b0ad847-6c65-413d-b5b8-73f5e5df0800","Type":"ContainerStarted","Data":"70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f"}
Jul 30 22:49:25.144326 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.143856    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:25.145498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.145468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt" event={"ID":"a015858f-a588-4c84-9df5-7a6cde7f9f03","Type":"ContainerStarted","Data":"91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b"}
Jul 30 22:49:25.145664 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.145624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:25.162502 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.162429    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f7477f447-5s52r" podStartSLOduration=1.6535237139999999 podStartE2EDuration="4.162409283s" totalImagesPullingTime="2.508885569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:25.16170923 +0000 UTC m=+562.223170626" watchObservedRunningTime="2026-07-30 22:49:25.162409283 +0000 UTC m=+562.223870683"
Jul 30 22:49:25.181283 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:25.181221    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt" podStartSLOduration=2.052143549 podStartE2EDuration="4.181202764s" totalImagesPullingTime="2.129059215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:25.179015756 +0000 UTC m=+562.240477188" watchObservedRunningTime="2026-07-30 22:49:25.181202764 +0000 UTC m=+562.242664500"
Jul 30 22:49:36.152915 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.152876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:36.153505 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.152966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:49:36.264370 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.264332    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c7b5c47b4-lr9xt"]
Jul 30 22:49:36.264605 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.264557    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt" podUID="a015858f-a588-4c84-9df5-7a6cde7f9f03" containerName="manager" containerID="cri-o://91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b" gracePeriod=30
Jul 30 22:49:36.506847 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.506816    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:36.649905 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.649865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf9mv\" (UniqueName: \"kubernetes.io/projected/a015858f-a588-4c84-9df5-7a6cde7f9f03-kube-api-access-xf9mv\") pod \"a015858f-a588-4c84-9df5-7a6cde7f9f03\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") "
Jul 30 22:49:36.650097 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.649960    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert\") pod \"a015858f-a588-4c84-9df5-7a6cde7f9f03\" (UID: \"a015858f-a588-4c84-9df5-7a6cde7f9f03\") "
Jul 30 22:49:36.652380 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.652346    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a015858f-a588-4c84-9df5-7a6cde7f9f03" (UID: "a015858f-a588-4c84-9df5-7a6cde7f9f03"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:49:36.652511 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.652412    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a015858f-a588-4c84-9df5-7a6cde7f9f03-kube-api-access-xf9mv" (OuterVolumeSpecName: "kube-api-access-xf9mv") pod "a015858f-a588-4c84-9df5-7a6cde7f9f03" (UID: "a015858f-a588-4c84-9df5-7a6cde7f9f03"). InnerVolumeSpecName "kube-api-access-xf9mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:49:36.750776 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.750694    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a015858f-a588-4c84-9df5-7a6cde7f9f03-webhook-cert\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:49:36.750776 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:36.750724    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf9mv\" (UniqueName: \"kubernetes.io/projected/a015858f-a588-4c84-9df5-7a6cde7f9f03-kube-api-access-xf9mv\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:49:37.202065 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.202027    2565 generic.go:356] "Generic (PLEG): container finished" podID="a015858f-a588-4c84-9df5-7a6cde7f9f03" containerID="91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b" exitCode=0
Jul 30 22:49:37.202065 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.202070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt" event={"ID":"a015858f-a588-4c84-9df5-7a6cde7f9f03","Type":"ContainerDied","Data":"91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b"}
Jul 30 22:49:37.202677 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.202075    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt"
Jul 30 22:49:37.202677 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.202113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7b5c47b4-lr9xt" event={"ID":"a015858f-a588-4c84-9df5-7a6cde7f9f03","Type":"ContainerDied","Data":"d969b394ed6d788f1d4e456c860aa4a4171afef387d5aa5ecf77039192b2bc0f"}
Jul 30 22:49:37.202677 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.202137    2565 scope.go:117] "RemoveContainer" containerID="91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b"
Jul 30 22:49:37.212180 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.212155    2565 scope.go:117] "RemoveContainer" containerID="91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b"
Jul 30 22:49:37.212548 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:49:37.212525    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b\": container with ID starting with 91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b not found: ID does not exist" containerID="91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b"
Jul 30 22:49:37.212620 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.212561    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b"} err="failed to get container status \"91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b\": rpc error: code = NotFound desc = could not find container \"91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b\": container with ID starting with 91da880e522019e8a18488534b10cf5a5409238ef7559e0053103cf0d3ed657b not found: ID does not exist"
Jul 30 22:49:37.226653 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.226612    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c7b5c47b4-lr9xt"]
Jul 30 22:49:37.231623 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.231570    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c7b5c47b4-lr9xt"]
Jul 30 22:49:37.472816 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:37.470382    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a015858f-a588-4c84-9df5-7a6cde7f9f03" path="/var/lib/kubelet/pods/a015858f-a588-4c84-9df5-7a6cde7f9f03/volumes"
Jul 30 22:49:54.673187 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:54.673140    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:54.766287 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:54.766244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:56.177917 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.177879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:56.402301 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.402260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:56.476116 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.476033    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"]
Jul 30 22:49:56.476396 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.476383    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a015858f-a588-4c84-9df5-7a6cde7f9f03" containerName="manager"
Jul 30 22:49:56.476438 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.476398    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a015858f-a588-4c84-9df5-7a6cde7f9f03" containerName="manager"
Jul 30 22:49:56.476472 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.476450    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a015858f-a588-4c84-9df5-7a6cde7f9f03" containerName="manager"
Jul 30 22:49:56.479477 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.479461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.483783 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.483759    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 30 22:49:56.483783 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.483771    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-d4pqq\""
Jul 30 22:49:56.483783 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.483771    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 22:49:56.484041 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.483772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 22:49:56.490872 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.490845    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"]
Jul 30 22:49:56.635731 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.635695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0146856b-8dc4-4fc1-8588-8cc6202988a1-maas-api-tls\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.635731 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.635738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q92v\" (UniqueName: \"kubernetes.io/projected/0146856b-8dc4-4fc1-8588-8cc6202988a1-kube-api-access-4q92v\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.635950 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.635780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0146856b-8dc4-4fc1-8588-8cc6202988a1-openshift-service-ca\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.736819 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.736729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0146856b-8dc4-4fc1-8588-8cc6202988a1-maas-api-tls\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.736819 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.736776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q92v\" (UniqueName: \"kubernetes.io/projected/0146856b-8dc4-4fc1-8588-8cc6202988a1-kube-api-access-4q92v\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.736819 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.736818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0146856b-8dc4-4fc1-8588-8cc6202988a1-openshift-service-ca\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.737444 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.737425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0146856b-8dc4-4fc1-8588-8cc6202988a1-openshift-service-ca\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.739808 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.739782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0146856b-8dc4-4fc1-8588-8cc6202988a1-maas-api-tls\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.747851 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.747822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q92v\" (UniqueName: \"kubernetes.io/projected/0146856b-8dc4-4fc1-8588-8cc6202988a1-kube-api-access-4q92v\") pod \"maas-api-5b76fdb84c-frqkx\" (UID: \"0146856b-8dc4-4fc1-8588-8cc6202988a1\") " pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.791297 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.791251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:56.853010 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.852967    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:56.949058 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.949029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"]
Jul 30 22:49:56.951326 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:49:56.951285    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0146856b_8dc4_4fc1_8588_8cc6202988a1.slice/crio-c7271cb745e6a531cd43bb982db6df55980f2f70c412ad2e82949ebb79289f12 WatchSource:0}: Error finding container c7271cb745e6a531cd43bb982db6df55980f2f70c412ad2e82949ebb79289f12: Status 404 returned error can't find the container with id c7271cb745e6a531cd43bb982db6df55980f2f70c412ad2e82949ebb79289f12
Jul 30 22:49:56.952208 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.952160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:56.973746 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.973709    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"]
Jul 30 22:49:56.977984 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.977957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:56.980765 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.980738    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 22:49:56.987812 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:56.987733    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"]
Jul 30 22:49:57.140970 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.140932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/474e30c9-d811-4204-b8e0-fecd2b719752-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p2rpw\" (UID: \"474e30c9-d811-4204-b8e0-fecd2b719752\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:57.141133 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.140986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvcvq\" (UniqueName: \"kubernetes.io/projected/474e30c9-d811-4204-b8e0-fecd2b719752-kube-api-access-fvcvq\") pod \"payload-pre-processing-687dbb6cf6-p2rpw\" (UID: \"474e30c9-d811-4204-b8e0-fecd2b719752\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:57.242265 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.242156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/474e30c9-d811-4204-b8e0-fecd2b719752-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p2rpw\" (UID: \"474e30c9-d811-4204-b8e0-fecd2b719752\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:57.242265 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.242224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvcvq\" (UniqueName: \"kubernetes.io/projected/474e30c9-d811-4204-b8e0-fecd2b719752-kube-api-access-fvcvq\") pod \"payload-pre-processing-687dbb6cf6-p2rpw\" (UID: \"474e30c9-d811-4204-b8e0-fecd2b719752\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:57.242964 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.242941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/474e30c9-d811-4204-b8e0-fecd2b719752-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p2rpw\" (UID: \"474e30c9-d811-4204-b8e0-fecd2b719752\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:57.251288 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.251260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvcvq\" (UniqueName: \"kubernetes.io/projected/474e30c9-d811-4204-b8e0-fecd2b719752-kube-api-access-fvcvq\") pod \"payload-pre-processing-687dbb6cf6-p2rpw\" (UID: \"474e30c9-d811-4204-b8e0-fecd2b719752\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:57.291192 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.291147    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:49:57.297889 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.297855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx" event={"ID":"0146856b-8dc4-4fc1-8588-8cc6202988a1","Type":"ContainerStarted","Data":"c7271cb745e6a531cd43bb982db6df55980f2f70c412ad2e82949ebb79289f12"}
Jul 30 22:49:57.438032 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:57.437938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"]
Jul 30 22:49:57.440338 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:49:57.440307    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474e30c9_d811_4204_b8e0_fecd2b719752.slice/crio-b54841885f9746dc88d051a890994dd13937db61f0499f577d6e76f138214f3f WatchSource:0}: Error finding container b54841885f9746dc88d051a890994dd13937db61f0499f577d6e76f138214f3f: Status 404 returned error can't find the container with id b54841885f9746dc88d051a890994dd13937db61f0499f577d6e76f138214f3f
Jul 30 22:49:58.310177 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:58.310133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw" event={"ID":"474e30c9-d811-4204-b8e0-fecd2b719752","Type":"ContainerStarted","Data":"b54841885f9746dc88d051a890994dd13937db61f0499f577d6e76f138214f3f"}
Jul 30 22:49:59.317780 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:59.317729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx" event={"ID":"0146856b-8dc4-4fc1-8588-8cc6202988a1","Type":"ContainerStarted","Data":"83a2078cb9102c7972ee8588201962183656f19ef6e071fd73b8e43999009aae"}
Jul 30 22:49:59.318213 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:59.317860    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:49:59.338656 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:49:59.338591    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx" podStartSLOduration=1.434102413 podStartE2EDuration="3.338555201s" totalImagesPullingTime="1.904452788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:59.337107574 +0000 UTC m=+596.398568971" watchObservedRunningTime="2026-07-30 22:49:59.338555201 +0000 UTC m=+596.400016601"
Jul 30 22:50:01.330359 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:01.330316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw" event={"ID":"474e30c9-d811-4204-b8e0-fecd2b719752","Type":"ContainerStarted","Data":"f6cbd1d3e955063bcac19f7372f47d4b618f22a3cc07644ed576532a2da25be2"}
Jul 30 22:50:01.330835 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:01.330426    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:50:01.350481 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:01.350429    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw" podStartSLOduration=2.268383126 podStartE2EDuration="5.350411109s" totalImagesPullingTime="3.082027983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:50:01.348619919 +0000 UTC m=+598.410081316" watchObservedRunningTime="2026-07-30 22:50:01.350411109 +0000 UTC m=+598.411872505"
Jul 30 22:50:03.414409 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:03.414380    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:50:03.416780 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:03.416732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:50:03.418901 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:03.418879    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:50:03.421814 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:03.421746    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:50:03.423780 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:03.423761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:50:03.426431 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:03.426415    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:50:05.331005 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:05.330965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b76fdb84c-frqkx"
Jul 30 22:50:05.949782 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:05.949730    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4p5gj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 22:50:05.950001 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:05.949799    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" podUID="422acd91-ea21-4b8d-8f7e-c30b80403284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 22:50:06.391277 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:06.391234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:06.487491 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:06.487451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:07.362413 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:07.362378    2565 generic.go:356] "Generic (PLEG): container finished" podID="422acd91-ea21-4b8d-8f7e-c30b80403284" containerID="4d3eaf69f39881f0e32b99a75019cae430ca3c2a9847b5219f9df19bcef8a3d3" exitCode=0
Jul 30 22:50:07.362670 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:07.362461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" event={"ID":"422acd91-ea21-4b8d-8f7e-c30b80403284","Type":"ContainerDied","Data":"4d3eaf69f39881f0e32b99a75019cae430ca3c2a9847b5219f9df19bcef8a3d3"}
Jul 30 22:50:07.362954 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:07.362938    2565 scope.go:117] "RemoveContainer" containerID="4d3eaf69f39881f0e32b99a75019cae430ca3c2a9847b5219f9df19bcef8a3d3"
Jul 30 22:50:07.364131 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:07.364105    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:50:07.364196 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:07.364172    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:50:07.364238 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:07.364206    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 22:50:08.369780 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:08.369747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" event={"ID":"422acd91-ea21-4b8d-8f7e-c30b80403284","Type":"ContainerStarted","Data":"f105eccea89417f37471d18d34212dfdffeccb003684c2e4b6eafb4e52a07dbf"}
Jul 30 22:50:08.950694 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:08.950648    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:50:08.950928 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:08.950899    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4p5gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 30 22:50:08.951023 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:08.950962    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" podUID="422acd91-ea21-4b8d-8f7e-c30b80403284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 30 22:50:09.950916 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:09.950871    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4p5gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 30 22:50:09.951342 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:09.950934    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" podUID="422acd91-ea21-4b8d-8f7e-c30b80403284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 30 22:50:10.950867 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:10.950828    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4p5gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 30 22:50:10.951072 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:10.950905    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" podUID="422acd91-ea21-4b8d-8f7e-c30b80403284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 30 22:50:11.951111 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:11.951071    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4p5gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 30 22:50:11.951634 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:11.951139    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" podUID="422acd91-ea21-4b8d-8f7e-c30b80403284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 30 22:50:12.337247 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:12.337155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p2rpw"
Jul 30 22:50:12.950919 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:12.950878    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4p5gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 30 22:50:12.951128 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:12.950953    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj" podUID="422acd91-ea21-4b8d-8f7e-c30b80403284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 30 22:50:13.953986 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:13.953951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:50:13.954410 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:13.954231    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:50:13.955008 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:13.954987    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4p5gj"
Jul 30 22:50:25.093646 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.093546    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"]
Jul 30 22:50:25.096300 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.096270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.099275 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.099247    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 22:50:25.100360 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.100338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 22:50:25.100489 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.100343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lvhf4\""
Jul 30 22:50:25.100489 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.100351    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 22:50:25.113826 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.113788    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"]
Jul 30 22:50:25.128474 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.128440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:25.227317 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.227279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.227498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.227344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.227498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.227393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.227498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.227416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pllt\" (UniqueName: \"kubernetes.io/projected/98a40368-c63b-4534-b7f0-070624146d19-kube-api-access-7pllt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.227498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.227467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.227498 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.227492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a40368-c63b-4534-b7f0-070624146d19-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.328744 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.328688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.328935 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.328755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.328935 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.328800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.328935 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.328827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pllt\" (UniqueName: \"kubernetes.io/projected/98a40368-c63b-4534-b7f0-070624146d19-kube-api-access-7pllt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.328935 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.328860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.328935 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.328884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a40368-c63b-4534-b7f0-070624146d19-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.329213 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.329187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.329258 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.329197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.329308 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.329289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.331377 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.331348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98a40368-c63b-4534-b7f0-070624146d19-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.331650 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.331630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a40368-c63b-4534-b7f0-070624146d19-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.338563 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.338539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pllt\" (UniqueName: \"kubernetes.io/projected/98a40368-c63b-4534-b7f0-070624146d19-kube-api-access-7pllt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8\" (UID: \"98a40368-c63b-4534-b7f0-070624146d19\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.407520 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.407485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:25.561729 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:25.561702    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"]
Jul 30 22:50:25.564449 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:50:25.564418    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a40368_c63b_4534_b7f0_070624146d19.slice/crio-06dec63f0a1155599a62111632c20d02f44d7af5c62a73292fade2a5ff058a23 WatchSource:0}: Error finding container 06dec63f0a1155599a62111632c20d02f44d7af5c62a73292fade2a5ff058a23: Status 404 returned error can't find the container with id 06dec63f0a1155599a62111632c20d02f44d7af5c62a73292fade2a5ff058a23
Jul 30 22:50:26.473167 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:26.473108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8" event={"ID":"98a40368-c63b-4534-b7f0-070624146d19","Type":"ContainerStarted","Data":"06dec63f0a1155599a62111632c20d02f44d7af5c62a73292fade2a5ff058a23"}
Jul 30 22:50:27.479382 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:27.479340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8" event={"ID":"98a40368-c63b-4534-b7f0-070624146d19","Type":"ContainerStarted","Data":"4fbb9f0d9d2334e32679f754b835df43e4856c624eba5b8f7b2012bf7f0774a9"}
Jul 30 22:50:27.501391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:27.501334    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8" podStartSLOduration=1.424950559 podStartE2EDuration="2.50131791s" totalImagesPullingTime="1.076367351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:50:27.499047901 +0000 UTC m=+624.560509299" watchObservedRunningTime="2026-07-30 22:50:27.50131791 +0000 UTC m=+624.562779306"
Jul 30 22:50:31.000720 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:31.000680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:35.408676 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:35.408625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:35.409191 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:35.408708    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:35.421818 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:35.421788    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:35.527764 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:35.527731    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8"
Jul 30 22:50:38.434961 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:38.434929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:53.395476 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.395438    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"]
Jul 30 22:50:53.403559 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.403467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.406440 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.406410    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 30 22:50:53.410448 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.410416    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"]
Jul 30 22:50:53.502393 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.502353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvr4\" (UniqueName: \"kubernetes.io/projected/1f901f06-3239-47c8-87c1-bb22c4f91dcf-kube-api-access-xwvr4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.502618 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.502407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.502618 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.502485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.502618 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.502536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.502763 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.502703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f901f06-3239-47c8-87c1-bb22c4f91dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.502763 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.502739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.513560 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.513512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:53.603424 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f901f06-3239-47c8-87c1-bb22c4f91dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.603644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.603644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvr4\" (UniqueName: \"kubernetes.io/projected/1f901f06-3239-47c8-87c1-bb22c4f91dcf-kube-api-access-xwvr4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.603644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.603644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.603644 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.604294 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.604294 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.603991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.604294 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.604251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.606726 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.606697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f901f06-3239-47c8-87c1-bb22c4f91dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.607096 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.607064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f901f06-3239-47c8-87c1-bb22c4f91dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.613315 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.613247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvr4\" (UniqueName: \"kubernetes.io/projected/1f901f06-3239-47c8-87c1-bb22c4f91dcf-kube-api-access-xwvr4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44\" (UID: \"1f901f06-3239-47c8-87c1-bb22c4f91dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.716735 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.716645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:50:53.864025 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:53.863989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"]
Jul 30 22:50:53.868032 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:50:53.867997    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f901f06_3239_47c8_87c1_bb22c4f91dcf.slice/crio-88a6011467477d4763cf8766d6ee1762337fabdd3c1696f1a94a7ca20bb2aa0a WatchSource:0}: Error finding container 88a6011467477d4763cf8766d6ee1762337fabdd3c1696f1a94a7ca20bb2aa0a: Status 404 returned error can't find the container with id 88a6011467477d4763cf8766d6ee1762337fabdd3c1696f1a94a7ca20bb2aa0a
Jul 30 22:50:54.610797 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:54.610681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44" event={"ID":"1f901f06-3239-47c8-87c1-bb22c4f91dcf","Type":"ContainerStarted","Data":"9cfc5392e9e9136d441421709e6fe950f0e5d829ff84422d6e0c3014c760b5a7"}
Jul 30 22:50:54.610797 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:54.610788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44" event={"ID":"1f901f06-3239-47c8-87c1-bb22c4f91dcf","Type":"ContainerStarted","Data":"88a6011467477d4763cf8766d6ee1762337fabdd3c1696f1a94a7ca20bb2aa0a"}
Jul 30 22:50:54.631878 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:50:54.631820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44" podStartSLOduration=1.436779602 podStartE2EDuration="1.631800981s" totalImagesPullingTime="195.021379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:50:54.629280399 +0000 UTC m=+651.690741794" watchObservedRunningTime="2026-07-30 22:50:54.631800981 +0000 UTC m=+651.693262377"
Jul 30 22:51:03.717705 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:03.717651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:51:03.718135 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:03.717739    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:51:03.730664 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:03.730635    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:51:04.670965 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:04.670930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44"
Jul 30 22:51:09.419355 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.419315    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"]
Jul 30 22:51:09.423735 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.423706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.426403 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.426377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 30 22:51:09.434197 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.434158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"]
Jul 30 22:51:09.456984 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.456942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:51:09.558686 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.558636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.558896 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.558713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r96fh\" (UniqueName: \"kubernetes.io/projected/f7cc376c-445d-4618-bed9-9374b202aa54-kube-api-access-r96fh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.558896 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.558744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.558896 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.558852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.559029 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.558895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cc376c-445d-4618-bed9-9374b202aa54-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.559029 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.558919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660308 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660308 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cc376c-445d-4618-bed9-9374b202aa54-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660637 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660637 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660637 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96fh\" (UniqueName: \"kubernetes.io/projected/f7cc376c-445d-4618-bed9-9374b202aa54-kube-api-access-r96fh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660637 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660867 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660928 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.660991 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.660975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.663095 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.663055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7cc376c-445d-4618-bed9-9374b202aa54-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.663391 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.663368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7cc376c-445d-4618-bed9-9374b202aa54-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.670457 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.670378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r96fh\" (UniqueName: \"kubernetes.io/projected/f7cc376c-445d-4618-bed9-9374b202aa54-kube-api-access-r96fh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k8gdj\" (UID: \"f7cc376c-445d-4618-bed9-9374b202aa54\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.736920 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.736871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:09.884304 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.884271    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"]
Jul 30 22:51:09.886490 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:51:09.886460    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cc376c_445d_4618_bed9_9374b202aa54.slice/crio-8e452858c47b09f5b8c2bd64e9dad321f0eb20e32108a9af0c2bbddf517db8ef WatchSource:0}: Error finding container 8e452858c47b09f5b8c2bd64e9dad321f0eb20e32108a9af0c2bbddf517db8ef: Status 404 returned error can't find the container with id 8e452858c47b09f5b8c2bd64e9dad321f0eb20e32108a9af0c2bbddf517db8ef
Jul 30 22:51:09.887937 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:09.887917    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:51:10.691418 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:10.691373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj" event={"ID":"f7cc376c-445d-4618-bed9-9374b202aa54","Type":"ContainerStarted","Data":"13a85d379c599d6fbe6a0097214a79ca399b25497f3e3f91089a8d73897fcb51"}
Jul 30 22:51:10.691983 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:10.691445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj" event={"ID":"f7cc376c-445d-4618-bed9-9374b202aa54","Type":"ContainerStarted","Data":"8e452858c47b09f5b8c2bd64e9dad321f0eb20e32108a9af0c2bbddf517db8ef"}
Jul 30 22:51:10.712035 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:10.711975    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj" podStartSLOduration=1.5001778780000001 podStartE2EDuration="1.711955322s" totalImagesPullingTime="211.777444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:51:10.709851308 +0000 UTC m=+667.771312705" watchObservedRunningTime="2026-07-30 22:51:10.711955322 +0000 UTC m=+667.773416717"
Jul 30 22:51:15.003807 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:15.003769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:51:15.533236 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:15.533199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:51:15.633825 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:15.633765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:51:19.737008 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:19.736974    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:19.737538 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:19.737041    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:19.750107 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:19.750078    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:51:20.753855 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:51:20.753816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k8gdj"
Jul 30 22:52:14.756710 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:52:14.756596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:14.875341 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:52:14.875298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:16.023252 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:52:16.023211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:16.112397 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:52:16.112355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:23.978486 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:52:23.978441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:55.849852 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:52:55.849813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:03.992399 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:03.992357    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7477f447-5s52r"]
Jul 30 22:53:03.992864 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:03.992601    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f7477f447-5s52r" podUID="2b0ad847-6c65-413d-b5b8-73f5e5df0800" containerName="manager" containerID="cri-o://70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f" gracePeriod=30
Jul 30 22:53:04.246344 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.246265    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:53:04.253460 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.253428    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b0ad847-6c65-413d-b5b8-73f5e5df0800" containerID="70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f" exitCode=0
Jul 30 22:53:04.253660 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.253478    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-5s52r"
Jul 30 22:53:04.253660 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.253512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-5s52r" event={"ID":"2b0ad847-6c65-413d-b5b8-73f5e5df0800","Type":"ContainerDied","Data":"70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f"}
Jul 30 22:53:04.253660 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.253563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-5s52r" event={"ID":"2b0ad847-6c65-413d-b5b8-73f5e5df0800","Type":"ContainerDied","Data":"1d7449c374b2590fc5ce79594ff14bed476cb86a2a4881619f91c26835626c4d"}
Jul 30 22:53:04.253660 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.253608    2565 scope.go:117] "RemoveContainer" containerID="70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f"
Jul 30 22:53:04.260051 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.260026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b0ad847-6c65-413d-b5b8-73f5e5df0800-webhook-cert\") pod \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") "
Jul 30 22:53:04.260206 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.260069    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr65f\" (UniqueName: \"kubernetes.io/projected/2b0ad847-6c65-413d-b5b8-73f5e5df0800-kube-api-access-hr65f\") pod \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\" (UID: \"2b0ad847-6c65-413d-b5b8-73f5e5df0800\") "
Jul 30 22:53:04.262389 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.262357    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0ad847-6c65-413d-b5b8-73f5e5df0800-kube-api-access-hr65f" (OuterVolumeSpecName: "kube-api-access-hr65f") pod "2b0ad847-6c65-413d-b5b8-73f5e5df0800" (UID: "2b0ad847-6c65-413d-b5b8-73f5e5df0800"). InnerVolumeSpecName "kube-api-access-hr65f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:53:04.262621 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.262569    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0ad847-6c65-413d-b5b8-73f5e5df0800-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2b0ad847-6c65-413d-b5b8-73f5e5df0800" (UID: "2b0ad847-6c65-413d-b5b8-73f5e5df0800"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:53:04.264060 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.263958    2565 scope.go:117] "RemoveContainer" containerID="70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f"
Jul 30 22:53:04.264665 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:53:04.264555    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f\": container with ID starting with 70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f not found: ID does not exist" containerID="70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f"
Jul 30 22:53:04.264665 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.264616    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f"} err="failed to get container status \"70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f\": rpc error: code = NotFound desc = could not find container \"70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f\": container with ID starting with 70bf298f073c4df428357bc42529f225e8b0927f4800cd0b56f64e441c8d7a9f not found: ID does not exist"
Jul 30 22:53:04.361253 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.361211    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b0ad847-6c65-413d-b5b8-73f5e5df0800-webhook-cert\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:53:04.361253 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.361246    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr65f\" (UniqueName: \"kubernetes.io/projected/2b0ad847-6c65-413d-b5b8-73f5e5df0800-kube-api-access-hr65f\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:53:04.576302 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.576264    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7477f447-5s52r"]
Jul 30 22:53:04.580329 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:04.580297    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f7477f447-5s52r"]
Jul 30 22:53:05.470956 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:05.470917    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0ad847-6c65-413d-b5b8-73f5e5df0800" path="/var/lib/kubelet/pods/2b0ad847-6c65-413d-b5b8-73f5e5df0800/volumes"
Jul 30 22:53:21.927451 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:53:21.927415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:05.437447 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.437408    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f7477f447-sf4gp"]
Jul 30 22:54:05.437888 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.437818    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0ad847-6c65-413d-b5b8-73f5e5df0800" containerName="manager"
Jul 30 22:54:05.437888 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.437831    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0ad847-6c65-413d-b5b8-73f5e5df0800" containerName="manager"
Jul 30 22:54:05.437888 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.437885    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0ad847-6c65-413d-b5b8-73f5e5df0800" containerName="manager"
Jul 30 22:54:05.441281 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.441262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.443863 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.443839    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 22:54:05.444007 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.443840    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 22:54:05.444779 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.444763    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-985p9\""
Jul 30 22:54:05.451713 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.451682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7477f447-sf4gp"]
Jul 30 22:54:05.560816 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.560780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqdc4\" (UniqueName: \"kubernetes.io/projected/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-kube-api-access-lqdc4\") pod \"maas-controller-f7477f447-sf4gp\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") " pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.561019 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.560956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-webhook-cert\") pod \"maas-controller-f7477f447-sf4gp\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") " pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.662211 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.662163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqdc4\" (UniqueName: \"kubernetes.io/projected/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-kube-api-access-lqdc4\") pod \"maas-controller-f7477f447-sf4gp\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") " pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.662402 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.662224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-webhook-cert\") pod \"maas-controller-f7477f447-sf4gp\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") " pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.664903 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.664866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-webhook-cert\") pod \"maas-controller-f7477f447-sf4gp\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") " pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.669865 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.669836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqdc4\" (UniqueName: \"kubernetes.io/projected/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-kube-api-access-lqdc4\") pod \"maas-controller-f7477f447-sf4gp\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") " pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.752563 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.752450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:05.907743 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:05.907711    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7477f447-sf4gp"]
Jul 30 22:54:05.909921 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:54:05.909891    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbc4ddb_0e6d_45d6_9f0b_e2068c2e9b33.slice/crio-bbffccdb64375e8dc4151385556db8dc1c94f273b30ccece068d8337582c997b WatchSource:0}: Error finding container bbffccdb64375e8dc4151385556db8dc1c94f273b30ccece068d8337582c997b: Status 404 returned error can't find the container with id bbffccdb64375e8dc4151385556db8dc1c94f273b30ccece068d8337582c997b
Jul 30 22:54:06.560550 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:06.560512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-sf4gp" event={"ID":"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33","Type":"ContainerStarted","Data":"acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28"}
Jul 30 22:54:06.561082 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:06.560590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-sf4gp" event={"ID":"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33","Type":"ContainerStarted","Data":"bbffccdb64375e8dc4151385556db8dc1c94f273b30ccece068d8337582c997b"}
Jul 30 22:54:06.561082 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:06.560707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:06.577949 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:06.577886    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f7477f447-sf4gp" podStartSLOduration=1.057074514 podStartE2EDuration="1.577865938s" totalImagesPullingTime="520.791424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:54:06.575398816 +0000 UTC m=+843.636860256" watchObservedRunningTime="2026-07-30 22:54:06.577865938 +0000 UTC m=+843.639327334"
Jul 30 22:54:17.568636 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:17.568568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:22.125093 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.125042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:22.222866 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.222824    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7477f447-sf4gp"]
Jul 30 22:54:22.223121 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.223082    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f7477f447-sf4gp" podUID="9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" containerName="manager" containerID="cri-o://acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28" gracePeriod=30
Jul 30 22:54:22.489172 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.489137    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:22.520800 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.520762    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-webhook-cert\") pod \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") "
Jul 30 22:54:22.521034 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.520870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqdc4\" (UniqueName: \"kubernetes.io/projected/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-kube-api-access-lqdc4\") pod \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\" (UID: \"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33\") "
Jul 30 22:54:22.523761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.523713    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" (UID: "9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:54:22.523761 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.523725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-kube-api-access-lqdc4" (OuterVolumeSpecName: "kube-api-access-lqdc4") pod "9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" (UID: "9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33"). InnerVolumeSpecName "kube-api-access-lqdc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:54:22.622424 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.622376    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqdc4\" (UniqueName: \"kubernetes.io/projected/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-kube-api-access-lqdc4\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:54:22.622424 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.622413    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33-webhook-cert\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 22:54:22.636908 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.636858    2565 generic.go:356] "Generic (PLEG): container finished" podID="9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" containerID="acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28" exitCode=0
Jul 30 22:54:22.637089 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.636916    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-sf4gp"
Jul 30 22:54:22.637089 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.636941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-sf4gp" event={"ID":"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33","Type":"ContainerDied","Data":"acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28"}
Jul 30 22:54:22.637089 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.636997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-sf4gp" event={"ID":"9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33","Type":"ContainerDied","Data":"bbffccdb64375e8dc4151385556db8dc1c94f273b30ccece068d8337582c997b"}
Jul 30 22:54:22.637089 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.637019    2565 scope.go:117] "RemoveContainer" containerID="acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28"
Jul 30 22:54:22.647461 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.647432    2565 scope.go:117] "RemoveContainer" containerID="acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28"
Jul 30 22:54:22.647820 ip-10-0-137-134 kubenswrapper[2565]: E0730 22:54:22.647795    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28\": container with ID starting with acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28 not found: ID does not exist" containerID="acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28"
Jul 30 22:54:22.647902 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.647833    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28"} err="failed to get container status \"acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28\": rpc error: code = NotFound desc = could not find container \"acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28\": container with ID starting with acf426049af80730efa7087034fbb1242b3f61600ba70c15aacdf6f097d4ad28 not found: ID does not exist"
Jul 30 22:54:22.660236 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.660136    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7477f447-sf4gp"]
Jul 30 22:54:22.666201 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:22.666170    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f7477f447-sf4gp"]
Jul 30 22:54:23.423556 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.423515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:23.470963 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.470916    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" path="/var/lib/kubelet/pods/9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33/volumes"
Jul 30 22:54:23.527631 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.527560    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f7477f447-ctkmb"]
Jul 30 22:54:23.528003 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.527990    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" containerName="manager"
Jul 30 22:54:23.528056 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.528005    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" containerName="manager"
Jul 30 22:54:23.528096 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.528069    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bbc4ddb-0e6d-45d6-9f0b-e2068c2e9b33" containerName="manager"
Jul 30 22:54:23.532781 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.532751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.536304 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.536281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 22:54:23.536440 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.536281    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 22:54:23.536440 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.536329    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-985p9\""
Jul 30 22:54:23.540908 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.540864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7477f447-ctkmb"]
Jul 30 22:54:23.633117 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.633066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eae8a323-75ae-4ca9-ae8c-caab2e454816-webhook-cert\") pod \"maas-controller-f7477f447-ctkmb\" (UID: \"eae8a323-75ae-4ca9-ae8c-caab2e454816\") " pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.633325 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.633142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdz9p\" (UniqueName: \"kubernetes.io/projected/eae8a323-75ae-4ca9-ae8c-caab2e454816-kube-api-access-mdz9p\") pod \"maas-controller-f7477f447-ctkmb\" (UID: \"eae8a323-75ae-4ca9-ae8c-caab2e454816\") " pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.733763 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.733658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eae8a323-75ae-4ca9-ae8c-caab2e454816-webhook-cert\") pod \"maas-controller-f7477f447-ctkmb\" (UID: \"eae8a323-75ae-4ca9-ae8c-caab2e454816\") " pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.733763 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.733738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdz9p\" (UniqueName: \"kubernetes.io/projected/eae8a323-75ae-4ca9-ae8c-caab2e454816-kube-api-access-mdz9p\") pod \"maas-controller-f7477f447-ctkmb\" (UID: \"eae8a323-75ae-4ca9-ae8c-caab2e454816\") " pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.736499 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.736469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eae8a323-75ae-4ca9-ae8c-caab2e454816-webhook-cert\") pod \"maas-controller-f7477f447-ctkmb\" (UID: \"eae8a323-75ae-4ca9-ae8c-caab2e454816\") " pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.743173 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.743143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdz9p\" (UniqueName: \"kubernetes.io/projected/eae8a323-75ae-4ca9-ae8c-caab2e454816-kube-api-access-mdz9p\") pod \"maas-controller-f7477f447-ctkmb\" (UID: \"eae8a323-75ae-4ca9-ae8c-caab2e454816\") " pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.844360 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.844308    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:23.985124 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:23.985092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7477f447-ctkmb"]
Jul 30 22:54:23.987820 ip-10-0-137-134 kubenswrapper[2565]: W0730 22:54:23.987789    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae8a323_75ae_4ca9_ae8c_caab2e454816.slice/crio-12407bb0d8666ed8a7109d76ac32cd00e31389f03497ed889c9c86a49f6f38ee WatchSource:0}: Error finding container 12407bb0d8666ed8a7109d76ac32cd00e31389f03497ed889c9c86a49f6f38ee: Status 404 returned error can't find the container with id 12407bb0d8666ed8a7109d76ac32cd00e31389f03497ed889c9c86a49f6f38ee
Jul 30 22:54:24.648970 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:24.648928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-ctkmb" event={"ID":"eae8a323-75ae-4ca9-ae8c-caab2e454816","Type":"ContainerStarted","Data":"51bc17111c68b2636a1dfa3d05ba8043397692673737a93b6905c14f977ffb11"}
Jul 30 22:54:24.649390 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:24.649045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7477f447-ctkmb" event={"ID":"eae8a323-75ae-4ca9-ae8c-caab2e454816","Type":"ContainerStarted","Data":"12407bb0d8666ed8a7109d76ac32cd00e31389f03497ed889c9c86a49f6f38ee"}
Jul 30 22:54:24.649390 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:24.649080    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:54:24.665991 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:24.665873    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f7477f447-ctkmb" podStartSLOduration=1.24546717 podStartE2EDuration="1.6658552s" totalImagesPullingTime="420.38803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:54:24.665325368 +0000 UTC m=+861.726786765" watchObservedRunningTime="2026-07-30 22:54:24.6658552 +0000 UTC m=+861.727316629"
Jul 30 22:54:29.646566 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:29.646525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:29.747074 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:29.747027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:35.656360 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:54:35.656324    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f7477f447-ctkmb"
Jul 30 22:55:03.449431 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:03.449401    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:55:03.450388 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:03.450362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 22:55:03.455149 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:03.455123    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:55:03.456059 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:03.456026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 22:55:03.460700 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:03.460680    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:55:03.461526 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:03.461507    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 22:55:15.008908 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:15.008839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:15.062483 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:15.062444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:26.945036 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:26.944994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:28.530125 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:28.530088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:32.827994 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:32.827957    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:32.937598 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:32.937543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:33.029254 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:33.029215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:33.218407 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:33.218363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:38.972163 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:38.972116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:39.030999 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:39.030946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:42.577353 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:55:42.577308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:12.322328 ip-10-0-137-134 kubenswrapper[2565]: I0730 22:58:12.322229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:00:03.482807 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:00:03.482777    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:00:03.483404 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:00:03.482880    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:00:03.487690 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:00:03.487663    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:00:03.487876 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:00:03.487853    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:00:03.494550 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:00:03.494525    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:00:03.495161 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:00:03.495137    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:00:21.178321 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:00:21.178282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:04:35.132142 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:04:35.132103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:04:37.096439 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:04:37.096402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:04:42.737053 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:04:42.736993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:04:47.635775 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:04:47.635740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:05:03.515062 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:03.515030    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:05:03.515670 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:03.515652    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:05:03.520061 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:03.520034    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:05:03.520617 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:03.520597    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:05:03.524876 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:03.524850    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:05:03.525531 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:03.525502    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:05:08.876747 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:08.876705    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:05:09.558764 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:09.558719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:05:29.664882 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:29.664796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:05:43.260171 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:05:43.260128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:06:17.764003 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:06:17.763964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:06:28.588747 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:06:28.588702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:08:32.395500 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:08:32.395406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:08:58.506101 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:08:58.506035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:01.749921 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:01.749880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:01.845381 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:01.845338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:02.249858 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:02.249805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:08.056982 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:08.056893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:08.120910 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:08.120861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:08.296909 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:08.296847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:08.643697 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:08.643643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:09.007376 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:09.007265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:13.929135 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:13.929094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:14.029795 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:14.029714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:15.027953 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.027905    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"]
Jul 30 23:09:15.032122 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.032090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.034539 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.034509    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5066b352-serving-cert\""
Jul 30 23:09:15.041777 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.041713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"]
Jul 30 23:09:15.059044 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.059003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:15.089653 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.089615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq5bw\" (UniqueName: \"kubernetes.io/projected/d6b20545-e793-4d74-8da6-bad2665fad8a-kube-api-access-sq5bw\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.089858 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.089757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b20545-e793-4d74-8da6-bad2665fad8a-openshift-service-ca\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.089858 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.089846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.190760 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.190710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.190983 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.190800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq5bw\" (UniqueName: \"kubernetes.io/projected/d6b20545-e793-4d74-8da6-bad2665fad8a-kube-api-access-sq5bw\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.190983 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:09:15.190867    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-serving-cert: secret "maas-api-e2e-ait-5066b352-serving-cert" not found
Jul 30 23:09:15.190983 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:09:15.190944    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls podName:d6b20545-e793-4d74-8da6-bad2665fad8a nodeName:}" failed. No retries permitted until 2026-07-30 23:09:15.690924618 +0000 UTC m=+1752.752385993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls") pod "maas-api-e2e-ait-5066b352-79f497cc85-v2qdw" (UID: "d6b20545-e793-4d74-8da6-bad2665fad8a") : secret "maas-api-e2e-ait-5066b352-serving-cert" not found
Jul 30 23:09:15.190983 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.190886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b20545-e793-4d74-8da6-bad2665fad8a-openshift-service-ca\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.191545 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.191519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b20545-e793-4d74-8da6-bad2665fad8a-openshift-service-ca\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.200034 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.199995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq5bw\" (UniqueName: \"kubernetes.io/projected/d6b20545-e793-4d74-8da6-bad2665fad8a-kube-api-access-sq5bw\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.495057 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.495022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:15.597844 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.597809    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:15.691774 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.691737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:15.696564 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.696521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.699279 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.699243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls\") pod \"maas-api-e2e-ait-5066b352-79f497cc85-v2qdw\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:15.946973 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:15.946924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:16.104780 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:16.104753    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"]
Jul 30 23:09:16.107531 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:09:16.107499    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b20545_e793_4d74_8da6_bad2665fad8a.slice/crio-617b4eaa717a87041bc1c58db60deb2549f84be6c4adf186285c231315aedde9 WatchSource:0}: Error finding container 617b4eaa717a87041bc1c58db60deb2549f84be6c4adf186285c231315aedde9: Status 404 returned error can't find the container with id 617b4eaa717a87041bc1c58db60deb2549f84be6c4adf186285c231315aedde9
Jul 30 23:09:16.109429 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:16.109400    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:09:16.167511 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:16.167470    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw" event={"ID":"d6b20545-e793-4d74-8da6-bad2665fad8a","Type":"ContainerStarted","Data":"617b4eaa717a87041bc1c58db60deb2549f84be6c4adf186285c231315aedde9"}
Jul 30 23:09:17.174441 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:17.174389    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw" event={"ID":"d6b20545-e793-4d74-8da6-bad2665fad8a","Type":"ContainerStarted","Data":"7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5"}
Jul 30 23:09:17.175096 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:17.174484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:17.196724 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:17.196635    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw" podStartSLOduration=1.686174862 podStartE2EDuration="2.196608675s" totalImagesPullingTime="510.433813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:09:17.192800194 +0000 UTC m=+1754.254261591" watchObservedRunningTime="2026-07-30 23:09:17.196608675 +0000 UTC m=+1754.258070072"
Jul 30 23:09:23.185197 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:23.185157    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:45.579283 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:45.579245    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"]
Jul 30 23:09:45.579873 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:45.579466    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw" podUID="d6b20545-e793-4d74-8da6-bad2665fad8a" containerName="maas-api" containerID="cri-o://7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5" gracePeriod=30
Jul 30 23:09:45.606679 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:45.606649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:45.845090 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:45.845005    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:46.002712 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.002673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls\") pod \"d6b20545-e793-4d74-8da6-bad2665fad8a\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") "
Jul 30 23:09:46.002926 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.002767    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b20545-e793-4d74-8da6-bad2665fad8a-openshift-service-ca\") pod \"d6b20545-e793-4d74-8da6-bad2665fad8a\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") "
Jul 30 23:09:46.002926 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.002808    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq5bw\" (UniqueName: \"kubernetes.io/projected/d6b20545-e793-4d74-8da6-bad2665fad8a-kube-api-access-sq5bw\") pod \"d6b20545-e793-4d74-8da6-bad2665fad8a\" (UID: \"d6b20545-e793-4d74-8da6-bad2665fad8a\") "
Jul 30 23:09:46.003252 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.003218    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b20545-e793-4d74-8da6-bad2665fad8a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6b20545-e793-4d74-8da6-bad2665fad8a" (UID: "d6b20545-e793-4d74-8da6-bad2665fad8a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:09:46.005560 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.005524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6b20545-e793-4d74-8da6-bad2665fad8a" (UID: "d6b20545-e793-4d74-8da6-bad2665fad8a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:09:46.005722 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.005623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b20545-e793-4d74-8da6-bad2665fad8a-kube-api-access-sq5bw" (OuterVolumeSpecName: "kube-api-access-sq5bw") pod "d6b20545-e793-4d74-8da6-bad2665fad8a" (UID: "d6b20545-e793-4d74-8da6-bad2665fad8a"). InnerVolumeSpecName "kube-api-access-sq5bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:09:46.104563 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.104463    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6b20545-e793-4d74-8da6-bad2665fad8a-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:09:46.104563 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.104501    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b20545-e793-4d74-8da6-bad2665fad8a-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:09:46.104563 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.104511    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq5bw\" (UniqueName: \"kubernetes.io/projected/d6b20545-e793-4d74-8da6-bad2665fad8a-kube-api-access-sq5bw\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:09:46.324075 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.324034    2565 generic.go:356] "Generic (PLEG): container finished" podID="d6b20545-e793-4d74-8da6-bad2665fad8a" containerID="7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5" exitCode=0
Jul 30 23:09:46.324075 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.324080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw" event={"ID":"d6b20545-e793-4d74-8da6-bad2665fad8a","Type":"ContainerDied","Data":"7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5"}
Jul 30 23:09:46.324334 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.324083    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"
Jul 30 23:09:46.324334 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.324125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw" event={"ID":"d6b20545-e793-4d74-8da6-bad2665fad8a","Type":"ContainerDied","Data":"617b4eaa717a87041bc1c58db60deb2549f84be6c4adf186285c231315aedde9"}
Jul 30 23:09:46.324334 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.324149    2565 scope.go:117] "RemoveContainer" containerID="7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5"
Jul 30 23:09:46.334167 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.334144    2565 scope.go:117] "RemoveContainer" containerID="7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5"
Jul 30 23:09:46.334473 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:09:46.334450    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5\": container with ID starting with 7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5 not found: ID does not exist" containerID="7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5"
Jul 30 23:09:46.334559 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.334480    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5"} err="failed to get container status \"7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5\": rpc error: code = NotFound desc = could not find container \"7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5\": container with ID starting with 7ffffe102e82a8e1ab981eab57d3e270acedb80b10d15355223cc42b2c80d8c5 not found: ID does not exist"
Jul 30 23:09:46.348033 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.347995    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"]
Jul 30 23:09:46.353535 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:46.353499    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5066b352-79f497cc85-v2qdw"]
Jul 30 23:09:47.036102 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:47.036061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:47.136468 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:47.136434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:47.471990 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:47.471953    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b20545-e793-4d74-8da6-bad2665fad8a" path="/var/lib/kubelet/pods/d6b20545-e793-4d74-8da6-bad2665fad8a/volumes"
Jul 30 23:09:49.286897 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.286863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:49.371145 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.371101    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"]
Jul 30 23:09:49.371653 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.371628    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b20545-e793-4d74-8da6-bad2665fad8a" containerName="maas-api"
Jul 30 23:09:49.371653 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.371652    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b20545-e793-4d74-8da6-bad2665fad8a" containerName="maas-api"
Jul 30 23:09:49.371866 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.371791    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b20545-e793-4d74-8da6-bad2665fad8a" containerName="maas-api"
Jul 30 23:09:49.376723 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.376688    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.379114 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.379080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-0aa67640-serving-cert\""
Jul 30 23:09:49.383708 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.383678    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"]
Jul 30 23:09:49.427261 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.427221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:49.539659 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.539509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt27b\" (UniqueName: \"kubernetes.io/projected/7e0e46e0-cc36-4e2a-8728-620a2b10143f-kube-api-access-wt27b\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.539659 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.539621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0e46e0-cc36-4e2a-8728-620a2b10143f-maas-api-tls\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.539871 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.539683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e46e0-cc36-4e2a-8728-620a2b10143f-openshift-service-ca\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.641110 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.641069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e46e0-cc36-4e2a-8728-620a2b10143f-openshift-service-ca\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.641337 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.641211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt27b\" (UniqueName: \"kubernetes.io/projected/7e0e46e0-cc36-4e2a-8728-620a2b10143f-kube-api-access-wt27b\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.641337 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.641276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0e46e0-cc36-4e2a-8728-620a2b10143f-maas-api-tls\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.641911 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.641884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e46e0-cc36-4e2a-8728-620a2b10143f-openshift-service-ca\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.644108 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.644086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0e46e0-cc36-4e2a-8728-620a2b10143f-maas-api-tls\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.653632 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.653563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt27b\" (UniqueName: \"kubernetes.io/projected/7e0e46e0-cc36-4e2a-8728-620a2b10143f-kube-api-access-wt27b\") pod \"maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.664830 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.664793    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:49.692027 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.691984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:49.853138 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.853106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"]
Jul 30 23:09:49.856155 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:09:49.856115    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0e46e0_cc36_4e2a_8728_620a2b10143f.slice/crio-066d2981cae17abec6fb663a0cd1ea208ba07d7344bfbc1122db52f821fae951 WatchSource:0}: Error finding container 066d2981cae17abec6fb663a0cd1ea208ba07d7344bfbc1122db52f821fae951: Status 404 returned error can't find the container with id 066d2981cae17abec6fb663a0cd1ea208ba07d7344bfbc1122db52f821fae951
Jul 30 23:09:49.934548 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:49.934511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:50.038163 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:50.038115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:50.347684 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:50.347632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5" event={"ID":"7e0e46e0-cc36-4e2a-8728-620a2b10143f","Type":"ContainerStarted","Data":"7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79"}
Jul 30 23:09:50.348136 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:50.347744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5" event={"ID":"7e0e46e0-cc36-4e2a-8728-620a2b10143f","Type":"ContainerStarted","Data":"066d2981cae17abec6fb663a0cd1ea208ba07d7344bfbc1122db52f821fae951"}
Jul 30 23:09:50.348136 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:50.347770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:09:50.366705 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:50.366647    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5" podStartSLOduration=0.988637163 podStartE2EDuration="1.36662933s" totalImagesPullingTime="377.992167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:09:50.364820495 +0000 UTC m=+1787.426281906" watchObservedRunningTime="2026-07-30 23:09:50.36662933 +0000 UTC m=+1787.428090725"
Jul 30 23:09:56.360077 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:09:56.359996    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:10:03.546714 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:03.546683    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:10:03.548235 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:03.548212    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:10:03.551922 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:03.551902    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:10:03.553502 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:03.553475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:10:03.557032 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:03.557010    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:10:03.558283 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:03.558264    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:10:19.968024 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:19.967971    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"]
Jul 30 23:10:19.968721 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:19.968222    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5" podUID="7e0e46e0-cc36-4e2a-8728-620a2b10143f" containerName="maas-api" containerID="cri-o://7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79" gracePeriod=30
Jul 30 23:10:20.000804 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.000771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:20.100773 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.100741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:20.171791 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.171738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:20.236530 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.236493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:20.241632 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.241602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:10:20.351249 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.351214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0e46e0-cc36-4e2a-8728-620a2b10143f-maas-api-tls\") pod \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") "
Jul 30 23:10:20.351478 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.351290    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e46e0-cc36-4e2a-8728-620a2b10143f-openshift-service-ca\") pod \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") "
Jul 30 23:10:20.351478 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.351434    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt27b\" (UniqueName: \"kubernetes.io/projected/7e0e46e0-cc36-4e2a-8728-620a2b10143f-kube-api-access-wt27b\") pod \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\" (UID: \"7e0e46e0-cc36-4e2a-8728-620a2b10143f\") "
Jul 30 23:10:20.351761 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.351732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0e46e0-cc36-4e2a-8728-620a2b10143f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e0e46e0-cc36-4e2a-8728-620a2b10143f" (UID: "7e0e46e0-cc36-4e2a-8728-620a2b10143f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:10:20.351923 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.351847    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e46e0-cc36-4e2a-8728-620a2b10143f-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:10:20.353924 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.353888    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0e46e0-cc36-4e2a-8728-620a2b10143f-kube-api-access-wt27b" (OuterVolumeSpecName: "kube-api-access-wt27b") pod "7e0e46e0-cc36-4e2a-8728-620a2b10143f" (UID: "7e0e46e0-cc36-4e2a-8728-620a2b10143f"). InnerVolumeSpecName "kube-api-access-wt27b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:10:20.354061 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.354043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0e46e0-cc36-4e2a-8728-620a2b10143f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e0e46e0-cc36-4e2a-8728-620a2b10143f" (UID: "7e0e46e0-cc36-4e2a-8728-620a2b10143f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:10:20.362650 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.362609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:20.453145 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.453099    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt27b\" (UniqueName: \"kubernetes.io/projected/7e0e46e0-cc36-4e2a-8728-620a2b10143f-kube-api-access-wt27b\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:10:20.453145 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.453138    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0e46e0-cc36-4e2a-8728-620a2b10143f-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:10:20.504859 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.504764    2565 generic.go:356] "Generic (PLEG): container finished" podID="7e0e46e0-cc36-4e2a-8728-620a2b10143f" containerID="7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79" exitCode=0
Jul 30 23:10:20.504859 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.504809    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"
Jul 30 23:10:20.505080 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.504851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5" event={"ID":"7e0e46e0-cc36-4e2a-8728-620a2b10143f","Type":"ContainerDied","Data":"7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79"}
Jul 30 23:10:20.505080 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.504919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5" event={"ID":"7e0e46e0-cc36-4e2a-8728-620a2b10143f","Type":"ContainerDied","Data":"066d2981cae17abec6fb663a0cd1ea208ba07d7344bfbc1122db52f821fae951"}
Jul 30 23:10:20.505080 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.504945    2565 scope.go:117] "RemoveContainer" containerID="7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79"
Jul 30 23:10:20.514958 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.514933    2565 scope.go:117] "RemoveContainer" containerID="7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79"
Jul 30 23:10:20.515261 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:10:20.515244    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79\": container with ID starting with 7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79 not found: ID does not exist" containerID="7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79"
Jul 30 23:10:20.515324 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.515269    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79"} err="failed to get container status \"7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79\": rpc error: code = NotFound desc = could not find container \"7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79\": container with ID starting with 7b36d2f274a2f5c79cd75d6f0ee0cedaaa0a0efc2e338682430dc21920898d79 not found: ID does not exist"
Jul 30 23:10:20.551391 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.551343    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"]
Jul 30 23:10:20.559008 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.558971    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0aa67640-76cd64c67d-jmmz5"]
Jul 30 23:10:20.607742 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.607704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:20.832660 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:20.832531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:21.170727 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:21.170686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:21.471296 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:21.471203    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0e46e0-cc36-4e2a-8728-620a2b10143f" path="/var/lib/kubelet/pods/7e0e46e0-cc36-4e2a-8728-620a2b10143f/volumes"
Jul 30 23:10:21.795691 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:21.795600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:23.387407 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:23.387372    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:23.486852 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:23.486810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:24.672327 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.672274    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"]
Jul 30 23:10:24.672861 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.672838    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0e46e0-cc36-4e2a-8728-620a2b10143f" containerName="maas-api"
Jul 30 23:10:24.672861 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.672855    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0e46e0-cc36-4e2a-8728-620a2b10143f" containerName="maas-api"
Jul 30 23:10:24.672992 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.672923    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0e46e0-cc36-4e2a-8728-620a2b10143f" containerName="maas-api"
Jul 30 23:10:24.677461 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.677433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.680283 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.680258    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b7dedfa4-serving-cert\""
Jul 30 23:10:24.684467 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.684429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"]
Jul 30 23:10:24.694665 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.694614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538d2368-2959-42c0-bfa0-0091235866f8-openshift-service-ca\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.694840 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.694729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.694840 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.694818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7tjb\" (UniqueName: \"kubernetes.io/projected/538d2368-2959-42c0-bfa0-0091235866f8-kube-api-access-x7tjb\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.700380 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.700337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:24.795440 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.795398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538d2368-2959-42c0-bfa0-0091235866f8-openshift-service-ca\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.795665 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.795479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.795665 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.795541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7tjb\" (UniqueName: \"kubernetes.io/projected/538d2368-2959-42c0-bfa0-0091235866f8-kube-api-access-x7tjb\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.795753 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:10:24.795670    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-serving-cert: secret "maas-api-e2e-ait-b7dedfa4-serving-cert" not found
Jul 30 23:10:24.795792 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:10:24.795751    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls podName:538d2368-2959-42c0-bfa0-0091235866f8 nodeName:}" failed. No retries permitted until 2026-07-30 23:10:25.295729572 +0000 UTC m=+1822.357190953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls") pod "maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh" (UID: "538d2368-2959-42c0-bfa0-0091235866f8") : secret "maas-api-e2e-ait-b7dedfa4-serving-cert" not found
Jul 30 23:10:24.796128 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.796109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538d2368-2959-42c0-bfa0-0091235866f8-openshift-service-ca\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.804273 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.804237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7tjb\" (UniqueName: \"kubernetes.io/projected/538d2368-2959-42c0-bfa0-0091235866f8-kube-api-access-x7tjb\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:24.999394 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:24.999301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:25.197267 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:25.197228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:25.300145 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:25.300043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:25.302904 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:25.302877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls\") pod \"maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:25.401207 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:25.401170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:25.591232 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:25.591123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:25.749926 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:25.749897    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"]
Jul 30 23:10:25.752785 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:10:25.752745    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538d2368_2959_42c0_bfa0_0091235866f8.slice/crio-55117b54d1a525c2b9043eb503b8a69075cbc9959d43df2e0214efae808b9cb2 WatchSource:0}: Error finding container 55117b54d1a525c2b9043eb503b8a69075cbc9959d43df2e0214efae808b9cb2: Status 404 returned error can't find the container with id 55117b54d1a525c2b9043eb503b8a69075cbc9959d43df2e0214efae808b9cb2
Jul 30 23:10:26.545660 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:26.545550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh" event={"ID":"538d2368-2959-42c0-bfa0-0091235866f8","Type":"ContainerStarted","Data":"163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8"}
Jul 30 23:10:26.545660 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:26.545625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh" event={"ID":"538d2368-2959-42c0-bfa0-0091235866f8","Type":"ContainerStarted","Data":"55117b54d1a525c2b9043eb503b8a69075cbc9959d43df2e0214efae808b9cb2"}
Jul 30 23:10:26.545913 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:26.545717    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:26.568420 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:26.568358    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh" podStartSLOduration=2.117220505 podStartE2EDuration="2.568338973s" totalImagesPullingTime="451.118468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:10:26.565731972 +0000 UTC m=+1823.627193368" watchObservedRunningTime="2026-07-30 23:10:26.568338973 +0000 UTC m=+1823.629800368"
Jul 30 23:10:32.556216 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:32.556182    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:55.132957 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.132901    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"]
Jul 30 23:10:55.133998 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.133213    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh" podUID="538d2368-2959-42c0-bfa0-0091235866f8" containerName="maas-api" containerID="cri-o://163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8" gracePeriod=30
Jul 30 23:10:55.164180 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.164148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:55.264396 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.264366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:55.334693 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.334662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:55.392908 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.392872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:55.409224 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.409193    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:55.517235 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.517187    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538d2368-2959-42c0-bfa0-0091235866f8-openshift-service-ca\") pod \"538d2368-2959-42c0-bfa0-0091235866f8\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") "
Jul 30 23:10:55.517442 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.517304    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7tjb\" (UniqueName: \"kubernetes.io/projected/538d2368-2959-42c0-bfa0-0091235866f8-kube-api-access-x7tjb\") pod \"538d2368-2959-42c0-bfa0-0091235866f8\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") "
Jul 30 23:10:55.517442 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.517353    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls\") pod \"538d2368-2959-42c0-bfa0-0091235866f8\" (UID: \"538d2368-2959-42c0-bfa0-0091235866f8\") "
Jul 30 23:10:55.517744 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.517716    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538d2368-2959-42c0-bfa0-0091235866f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "538d2368-2959-42c0-bfa0-0091235866f8" (UID: "538d2368-2959-42c0-bfa0-0091235866f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:10:55.520201 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.520168    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "538d2368-2959-42c0-bfa0-0091235866f8" (UID: "538d2368-2959-42c0-bfa0-0091235866f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:10:55.520331 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.520236    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/538d2368-2959-42c0-bfa0-0091235866f8-kube-api-access-x7tjb" (OuterVolumeSpecName: "kube-api-access-x7tjb") pod "538d2368-2959-42c0-bfa0-0091235866f8" (UID: "538d2368-2959-42c0-bfa0-0091235866f8"). InnerVolumeSpecName "kube-api-access-x7tjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:10:55.618912 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.618874    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7tjb\" (UniqueName: \"kubernetes.io/projected/538d2368-2959-42c0-bfa0-0091235866f8-kube-api-access-x7tjb\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:10:55.618912 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.618908    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/538d2368-2959-42c0-bfa0-0091235866f8-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:10:55.618912 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.618917    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/538d2368-2959-42c0-bfa0-0091235866f8-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:10:55.699178 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.699079    2565 generic.go:356] "Generic (PLEG): container finished" podID="538d2368-2959-42c0-bfa0-0091235866f8" containerID="163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8" exitCode=0
Jul 30 23:10:55.699178 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.699156    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"
Jul 30 23:10:55.699414 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.699173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh" event={"ID":"538d2368-2959-42c0-bfa0-0091235866f8","Type":"ContainerDied","Data":"163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8"}
Jul 30 23:10:55.699414 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.699267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh" event={"ID":"538d2368-2959-42c0-bfa0-0091235866f8","Type":"ContainerDied","Data":"55117b54d1a525c2b9043eb503b8a69075cbc9959d43df2e0214efae808b9cb2"}
Jul 30 23:10:55.699414 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.699294    2565 scope.go:117] "RemoveContainer" containerID="163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8"
Jul 30 23:10:55.709860 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.709836    2565 scope.go:117] "RemoveContainer" containerID="163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8"
Jul 30 23:10:55.710215 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:10:55.710193    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8\": container with ID starting with 163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8 not found: ID does not exist" containerID="163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8"
Jul 30 23:10:55.710263 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.710227    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8"} err="failed to get container status \"163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8\": rpc error: code = NotFound desc = could not find container \"163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8\": container with ID starting with 163c358f2536eb2ce3772f49c25833aa0523840486045274877d7028ef51b3b8 not found: ID does not exist"
Jul 30 23:10:55.722520 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.722483    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"]
Jul 30 23:10:55.724378 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:55.724354    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b7dedfa4-b4dcd8d7-29cgh"]
Jul 30 23:10:56.529848 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:56.529814    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:56.768222 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:56.768183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:57.003409 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:57.003374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:57.301101 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:57.301017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:57.469964 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:57.469927    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="538d2368-2959-42c0-bfa0-0091235866f8" path="/var/lib/kubelet/pods/538d2368-2959-42c0-bfa0-0091235866f8/volumes"
Jul 30 23:10:57.532063 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:57.532022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:59.620035 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:59.620000    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:10:59.712530 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:10:59.712493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:00.707799 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.707755    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"]
Jul 30 23:11:00.708377 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.708362    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="538d2368-2959-42c0-bfa0-0091235866f8" containerName="maas-api"
Jul 30 23:11:00.708426 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.708381    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="538d2368-2959-42c0-bfa0-0091235866f8" containerName="maas-api"
Jul 30 23:11:00.708509 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.708498    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="538d2368-2959-42c0-bfa0-0091235866f8" containerName="maas-api"
Jul 30 23:11:00.713559 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.713529    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.715899 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.715874    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-94a93f51-serving-cert\""
Jul 30 23:11:00.722380 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.721976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"]
Jul 30 23:11:00.742961 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.742926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:00.769687 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.769650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.769894 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.769704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2p9r\" (UniqueName: \"kubernetes.io/projected/7a816588-7615-4960-a9a0-e8fe5f9b793a-kube-api-access-c2p9r\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.769894 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.769810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a816588-7615-4960-a9a0-e8fe5f9b793a-openshift-service-ca\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.873566 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.873525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a816588-7615-4960-a9a0-e8fe5f9b793a-openshift-service-ca\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.873922 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.873895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.873992 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.873976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2p9r\" (UniqueName: \"kubernetes.io/projected/7a816588-7615-4960-a9a0-e8fe5f9b793a-kube-api-access-c2p9r\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.874256 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:11:00.874212    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-serving-cert: secret "maas-api-e2e-derive-94a93f51-serving-cert" not found
Jul 30 23:11:00.874389 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:11:00.874299    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls podName:7a816588-7615-4960-a9a0-e8fe5f9b793a nodeName:}" failed. No retries permitted until 2026-07-30 23:11:01.374276904 +0000 UTC m=+1858.435738293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls") pod "maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt" (UID: "7a816588-7615-4960-a9a0-e8fe5f9b793a") : secret "maas-api-e2e-derive-94a93f51-serving-cert" not found
Jul 30 23:11:00.874673 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.874653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a816588-7615-4960-a9a0-e8fe5f9b793a-openshift-service-ca\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:00.883190 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:00.883154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2p9r\" (UniqueName: \"kubernetes.io/projected/7a816588-7615-4960-a9a0-e8fe5f9b793a-kube-api-access-c2p9r\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:01.060933 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:01.060837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:01.225443 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:01.225400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:01.329133 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:01.329035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:01.377352 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:01.377296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:01.380093 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:01.380064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls\") pod \"maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:01.629781 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:01.629738    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:01.791051 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:01.791010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"]
Jul 30 23:11:01.794870 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:11:01.794832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a816588_7615_4960_a9a0_e8fe5f9b793a.slice/crio-e65a408a1bf2a0bbf9e94f21b64afe2a037b3554b53f3fa21808d9c95803080c WatchSource:0}: Error finding container e65a408a1bf2a0bbf9e94f21b64afe2a037b3554b53f3fa21808d9c95803080c: Status 404 returned error can't find the container with id e65a408a1bf2a0bbf9e94f21b64afe2a037b3554b53f3fa21808d9c95803080c
Jul 30 23:11:02.743085 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:02.743045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt" event={"ID":"7a816588-7615-4960-a9a0-e8fe5f9b793a","Type":"ContainerStarted","Data":"9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690"}
Jul 30 23:11:02.743306 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:02.743102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt" event={"ID":"7a816588-7615-4960-a9a0-e8fe5f9b793a","Type":"ContainerStarted","Data":"e65a408a1bf2a0bbf9e94f21b64afe2a037b3554b53f3fa21808d9c95803080c"}
Jul 30 23:11:02.743306 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:02.743162    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:02.759465 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:02.759406    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt" podStartSLOduration=2.042231682 podStartE2EDuration="2.759385341s" totalImagesPullingTime="717.153659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:11:02.758639025 +0000 UTC m=+1859.820100420" watchObservedRunningTime="2026-07-30 23:11:02.759385341 +0000 UTC m=+1859.820846736"
Jul 30 23:11:08.752955 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:08.752916    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:31.242560 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.242455    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"]
Jul 30 23:11:31.243189 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.242779    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt" podUID="7a816588-7615-4960-a9a0-e8fe5f9b793a" containerName="maas-api" containerID="cri-o://9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690" gracePeriod=30
Jul 30 23:11:31.334694 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.334660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:31.436207 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.436156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:31.492384 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.492348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:31.510151 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.510121    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:31.593066 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.593033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2p9r\" (UniqueName: \"kubernetes.io/projected/7a816588-7615-4960-a9a0-e8fe5f9b793a-kube-api-access-c2p9r\") pod \"7a816588-7615-4960-a9a0-e8fe5f9b793a\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") "
Jul 30 23:11:31.593313 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.593132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls\") pod \"7a816588-7615-4960-a9a0-e8fe5f9b793a\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") "
Jul 30 23:11:31.593313 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.593165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a816588-7615-4960-a9a0-e8fe5f9b793a-openshift-service-ca\") pod \"7a816588-7615-4960-a9a0-e8fe5f9b793a\" (UID: \"7a816588-7615-4960-a9a0-e8fe5f9b793a\") "
Jul 30 23:11:31.593944 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.593910    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a816588-7615-4960-a9a0-e8fe5f9b793a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a816588-7615-4960-a9a0-e8fe5f9b793a" (UID: "7a816588-7615-4960-a9a0-e8fe5f9b793a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:11:31.596337 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.596257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:31.597645 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.597614    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a816588-7615-4960-a9a0-e8fe5f9b793a" (UID: "7a816588-7615-4960-a9a0-e8fe5f9b793a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:11:31.597763 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.597649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a816588-7615-4960-a9a0-e8fe5f9b793a-kube-api-access-c2p9r" (OuterVolumeSpecName: "kube-api-access-c2p9r") pod "7a816588-7615-4960-a9a0-e8fe5f9b793a" (UID: "7a816588-7615-4960-a9a0-e8fe5f9b793a"). InnerVolumeSpecName "kube-api-access-c2p9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:11:31.694373 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.694330    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a816588-7615-4960-a9a0-e8fe5f9b793a-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:11:31.694373 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.694368    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a816588-7615-4960-a9a0-e8fe5f9b793a-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:11:31.694373 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.694378    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2p9r\" (UniqueName: \"kubernetes.io/projected/7a816588-7615-4960-a9a0-e8fe5f9b793a-kube-api-access-c2p9r\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:11:31.843955 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.843861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:31.891671 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.891637    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a816588-7615-4960-a9a0-e8fe5f9b793a" containerID="9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690" exitCode=0
Jul 30 23:11:31.891876 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.891685    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"
Jul 30 23:11:31.891876 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.891691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt" event={"ID":"7a816588-7615-4960-a9a0-e8fe5f9b793a","Type":"ContainerDied","Data":"9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690"}
Jul 30 23:11:31.891876 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.891827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt" event={"ID":"7a816588-7615-4960-a9a0-e8fe5f9b793a","Type":"ContainerDied","Data":"e65a408a1bf2a0bbf9e94f21b64afe2a037b3554b53f3fa21808d9c95803080c"}
Jul 30 23:11:31.891876 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.891863    2565 scope.go:117] "RemoveContainer" containerID="9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690"
Jul 30 23:11:31.901372 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.901353    2565 scope.go:117] "RemoveContainer" containerID="9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690"
Jul 30 23:11:31.901690 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:11:31.901667    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690\": container with ID starting with 9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690 not found: ID does not exist" containerID="9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690"
Jul 30 23:11:31.901749 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.901700    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690"} err="failed to get container status \"9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690\": rpc error: code = NotFound desc = could not find container \"9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690\": container with ID starting with 9ec03fbb8cb0e7edc180c846eec353d3d3d8fcab00211a8d83b0359901d04690 not found: ID does not exist"
Jul 30 23:11:31.911982 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.911952    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"]
Jul 30 23:11:31.915738 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:31.915705    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-94a93f51-5b8bd64f85-m9ltt"]
Jul 30 23:11:32.339201 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:32.339156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:32.433439 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:32.433399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:32.532396 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:32.532356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:33.470495 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:33.470452    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a816588-7615-4960-a9a0-e8fe5f9b793a" path="/var/lib/kubelet/pods/7a816588-7615-4960-a9a0-e8fe5f9b793a/volumes"
Jul 30 23:11:44.318750 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:44.318706    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:50.482467 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:50.482416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:50.906770 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:50.906727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:51.011906 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:51.011863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:51.107683 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:51.107622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:51.208359 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:51.208234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:51.663113 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:11:51.663056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:17.684939 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:17.684896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:23.392632 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:23.392564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:23.495910 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:23.495855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:23.593638 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:23.593569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:39.536329 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:39.536244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:40.285321 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:40.285289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:45.209397 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:45.209361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:45.319106 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:45.319049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:45.410505 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:45.410472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:55.951987 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:12:55.951903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:07.060424 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:07.060381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:08.746994 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:08.746951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:08.801768 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:08.801726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:13.310063 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:13.310023    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:13.514653 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:13.514615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:13.608326 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:13.608237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:14.343181 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:14.343136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:14.435411 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:14.435377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:14.533907 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:14.533868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:16.188501 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:16.188464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:22.913299 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:22.913263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:23.013037 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:23.012999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:23.726747 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:23.726696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:29.839154 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:29.839111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:29.950097 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:29.950034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:30.101892 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:30.101806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:30.487902 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:30.487867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:30.797099 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:30.797009    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:33.340874 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:33.340838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:33.441357 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:33.441322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:34.439985 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.439954    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"]
Jul 30 23:13:34.440411 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.440367    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a816588-7615-4960-a9a0-e8fe5f9b793a" containerName="maas-api"
Jul 30 23:13:34.440411 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.440383    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a816588-7615-4960-a9a0-e8fe5f9b793a" containerName="maas-api"
Jul 30 23:13:34.440489 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.440459    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a816588-7615-4960-a9a0-e8fe5f9b793a" containerName="maas-api"
Jul 30 23:13:34.443737 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.443720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.455750 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.455714    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"]
Jul 30 23:13:34.458234 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.458207    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-85a1df81-serving-cert\""
Jul 30 23:13:34.466820 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.466765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:34.510600 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.510554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12b1600a-b053-43b3-9df6-7f04703a2eb7-openshift-service-ca\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.510600 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.510602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5bg\" (UniqueName: \"kubernetes.io/projected/12b1600a-b053-43b3-9df6-7f04703a2eb7-kube-api-access-nr5bg\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.510836 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.510633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.612024 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.611981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12b1600a-b053-43b3-9df6-7f04703a2eb7-openshift-service-ca\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.612024 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.612021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5bg\" (UniqueName: \"kubernetes.io/projected/12b1600a-b053-43b3-9df6-7f04703a2eb7-kube-api-access-nr5bg\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.612258 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.612062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.612258 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:13:34.612218    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-serving-cert: secret "maas-api-e2e-mt-85a1df81-serving-cert" not found
Jul 30 23:13:34.612333 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:13:34.612317    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls podName:12b1600a-b053-43b3-9df6-7f04703a2eb7 nodeName:}" failed. No retries permitted until 2026-07-30 23:13:35.112299737 +0000 UTC m=+2012.173761111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls") pod "maas-api-e2e-mt-85a1df81-554ff46775-x2l2g" (UID: "12b1600a-b053-43b3-9df6-7f04703a2eb7") : secret "maas-api-e2e-mt-85a1df81-serving-cert" not found
Jul 30 23:13:34.612713 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.612695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12b1600a-b053-43b3-9df6-7f04703a2eb7-openshift-service-ca\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.628255 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.628210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5bg\" (UniqueName: \"kubernetes.io/projected/12b1600a-b053-43b3-9df6-7f04703a2eb7-kube-api-access-nr5bg\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:34.716664 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.716511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:34.947953 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:34.947916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:35.041327 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:35.041226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:35.117233 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:35.117189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:35.120144 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:35.120108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls\") pod \"maas-api-e2e-mt-85a1df81-554ff46775-x2l2g\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:35.358831 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:35.358727    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:35.512978 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:13:35.512935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b1600a_b053_43b3_9df6_7f04703a2eb7.slice/crio-22fd6678618a7566f1f6272fb767ed1a941d61f9e59a3829dc3211dfe0eec1bb WatchSource:0}: Error finding container 22fd6678618a7566f1f6272fb767ed1a941d61f9e59a3829dc3211dfe0eec1bb: Status 404 returned error can't find the container with id 22fd6678618a7566f1f6272fb767ed1a941d61f9e59a3829dc3211dfe0eec1bb
Jul 30 23:13:35.515178 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:35.515142    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"]
Jul 30 23:13:35.519849 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:35.519816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g" event={"ID":"12b1600a-b053-43b3-9df6-7f04703a2eb7","Type":"ContainerStarted","Data":"22fd6678618a7566f1f6272fb767ed1a941d61f9e59a3829dc3211dfe0eec1bb"}
Jul 30 23:13:36.526825 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:36.526790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g" event={"ID":"12b1600a-b053-43b3-9df6-7f04703a2eb7","Type":"ContainerStarted","Data":"3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25"}
Jul 30 23:13:36.527264 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:36.526967    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:36.552034 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:36.551974    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g" podStartSLOduration=2.189425027 podStartE2EDuration="2.55195416s" totalImagesPullingTime="362.529133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:13:36.549871389 +0000 UTC m=+2013.611332785" watchObservedRunningTime="2026-07-30 23:13:36.55195416 +0000 UTC m=+2013.613415555"
Jul 30 23:13:42.537395 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:42.537363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:13:58.401492 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:58.401453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:59.071368 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:59.071336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:59.170951 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:59.170915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:13:59.578544 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:13:59.578505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:05.192979 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:05.192931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:05.347915 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:05.347876    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:16.141856 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.141810    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"]
Jul 30 23:14:16.142314 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.142108    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g" podUID="12b1600a-b053-43b3-9df6-7f04703a2eb7" containerName="maas-api" containerID="cri-o://3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25" gracePeriod=30
Jul 30 23:14:16.169349 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.169311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:16.239957 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.239917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:16.332210 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.332175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:16.400134 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.400091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:16.410232 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.410200    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:14:16.528194 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.528155    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12b1600a-b053-43b3-9df6-7f04703a2eb7-openshift-service-ca\") pod \"12b1600a-b053-43b3-9df6-7f04703a2eb7\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") "
Jul 30 23:14:16.528385 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.528319    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls\") pod \"12b1600a-b053-43b3-9df6-7f04703a2eb7\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") "
Jul 30 23:14:16.528385 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.528345    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr5bg\" (UniqueName: \"kubernetes.io/projected/12b1600a-b053-43b3-9df6-7f04703a2eb7-kube-api-access-nr5bg\") pod \"12b1600a-b053-43b3-9df6-7f04703a2eb7\" (UID: \"12b1600a-b053-43b3-9df6-7f04703a2eb7\") "
Jul 30 23:14:16.528657 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.528629    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b1600a-b053-43b3-9df6-7f04703a2eb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12b1600a-b053-43b3-9df6-7f04703a2eb7" (UID: "12b1600a-b053-43b3-9df6-7f04703a2eb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:14:16.530757 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.530719    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12b1600a-b053-43b3-9df6-7f04703a2eb7" (UID: "12b1600a-b053-43b3-9df6-7f04703a2eb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:14:16.530862 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.530834    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b1600a-b053-43b3-9df6-7f04703a2eb7-kube-api-access-nr5bg" (OuterVolumeSpecName: "kube-api-access-nr5bg") pod "12b1600a-b053-43b3-9df6-7f04703a2eb7" (UID: "12b1600a-b053-43b3-9df6-7f04703a2eb7"). InnerVolumeSpecName "kube-api-access-nr5bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:14:16.629766 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.629724    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12b1600a-b053-43b3-9df6-7f04703a2eb7-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:14:16.629766 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.629758    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr5bg\" (UniqueName: \"kubernetes.io/projected/12b1600a-b053-43b3-9df6-7f04703a2eb7-kube-api-access-nr5bg\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:14:16.629766 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.629767    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12b1600a-b053-43b3-9df6-7f04703a2eb7-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:14:16.730150 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.730056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:16.737181 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.737148    2565 generic.go:356] "Generic (PLEG): container finished" podID="12b1600a-b053-43b3-9df6-7f04703a2eb7" containerID="3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25" exitCode=0
Jul 30 23:14:16.737360 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.737198    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"
Jul 30 23:14:16.737360 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.737206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g" event={"ID":"12b1600a-b053-43b3-9df6-7f04703a2eb7","Type":"ContainerDied","Data":"3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25"}
Jul 30 23:14:16.737360 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.737254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g" event={"ID":"12b1600a-b053-43b3-9df6-7f04703a2eb7","Type":"ContainerDied","Data":"22fd6678618a7566f1f6272fb767ed1a941d61f9e59a3829dc3211dfe0eec1bb"}
Jul 30 23:14:16.737360 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.737276    2565 scope.go:117] "RemoveContainer" containerID="3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25"
Jul 30 23:14:16.749126 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.749102    2565 scope.go:117] "RemoveContainer" containerID="3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25"
Jul 30 23:14:16.749447 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:14:16.749424    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25\": container with ID starting with 3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25 not found: ID does not exist" containerID="3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25"
Jul 30 23:14:16.749495 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.749460    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25"} err="failed to get container status \"3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25\": rpc error: code = NotFound desc = could not find container \"3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25\": container with ID starting with 3cdbbca82da727f02524df80fa74d029ae9cc1dcbbea1bf67d920596895bea25 not found: ID does not exist"
Jul 30 23:14:16.760595 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.760537    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"]
Jul 30 23:14:16.764769 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:16.764733    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85a1df81-554ff46775-x2l2g"]
Jul 30 23:14:17.469840 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:17.469800    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b1600a-b053-43b3-9df6-7f04703a2eb7" path="/var/lib/kubelet/pods/12b1600a-b053-43b3-9df6-7f04703a2eb7/volumes"
Jul 30 23:14:22.335377 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:22.335337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:22.433134 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:22.433097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:22.604441 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:22.604352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:22.817281 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:22.817239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:22.940798 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:22.940758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:23.039566 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:23.039532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:23.201240 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:23.201149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:28.724112 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:28.724028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:28.833449 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:28.833414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:28.924012 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:28.923973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:29.083069 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:29.082972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:34.870452 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:34.870407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:14:34.970371 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:14:34.970335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:15:03.577949 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:03.577920    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:15:03.580410 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:03.580385    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:15:03.583433 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:03.583406    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:15:03.585509 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:03.585482    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:15:03.588274 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:03.588243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:15:03.590710 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:03.590688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:15:05.698910 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:05.698857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:15:29.421282 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:15:29.421197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:37.409449 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:37.409396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:37.738224 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:37.738073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:38.066627 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:38.066462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:41.263049 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:41.263013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:41.361887 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:41.361852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:42.365684 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.365636    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"]
Jul 30 23:16:42.366204 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.366061    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b1600a-b053-43b3-9df6-7f04703a2eb7" containerName="maas-api"
Jul 30 23:16:42.366204 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.366074    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b1600a-b053-43b3-9df6-7f04703a2eb7" containerName="maas-api"
Jul 30 23:16:42.366204 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.366134    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b1600a-b053-43b3-9df6-7f04703a2eb7" containerName="maas-api"
Jul 30 23:16:42.369396 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.369373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.371796 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.371764    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-604c6cd2-serving-cert\""
Jul 30 23:16:42.381002 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.380913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"]
Jul 30 23:16:42.401775 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.401733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:42.444699 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.444649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5404b840-b86c-4383-85a4-1e6866ef06d2-openshift-service-ca\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.444909 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.444786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5404b840-b86c-4383-85a4-1e6866ef06d2-maas-api-tls\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.444909 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.444833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qng9\" (UniqueName: \"kubernetes.io/projected/5404b840-b86c-4383-85a4-1e6866ef06d2-kube-api-access-6qng9\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.499116 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.499058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:42.545751 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.545707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5404b840-b86c-4383-85a4-1e6866ef06d2-openshift-service-ca\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.545952 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.545791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5404b840-b86c-4383-85a4-1e6866ef06d2-maas-api-tls\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.545952 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.545841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qng9\" (UniqueName: \"kubernetes.io/projected/5404b840-b86c-4383-85a4-1e6866ef06d2-kube-api-access-6qng9\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.546386 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.546356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5404b840-b86c-4383-85a4-1e6866ef06d2-openshift-service-ca\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.548684 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.548656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5404b840-b86c-4383-85a4-1e6866ef06d2-maas-api-tls\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.554373 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.554335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qng9\" (UniqueName: \"kubernetes.io/projected/5404b840-b86c-4383-85a4-1e6866ef06d2-kube-api-access-6qng9\") pod \"maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.682851 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.682821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:42.839201 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.839171    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"]
Jul 30 23:16:42.842403 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:16:42.842368    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5404b840_b86c_4383_85a4_1e6866ef06d2.slice/crio-6cc0ac34e043fd74ffccee9275c082e151334700dc0858ba16829086b6278b21 WatchSource:0}: Error finding container 6cc0ac34e043fd74ffccee9275c082e151334700dc0858ba16829086b6278b21: Status 404 returned error can't find the container with id 6cc0ac34e043fd74ffccee9275c082e151334700dc0858ba16829086b6278b21
Jul 30 23:16:42.843972 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.843948    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:16:42.941462 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:42.941362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:43.036959 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:43.036919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:43.476535 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:43.476483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6" event={"ID":"5404b840-b86c-4383-85a4-1e6866ef06d2","Type":"ContainerStarted","Data":"29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc"}
Jul 30 23:16:43.477109 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:43.476560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6" event={"ID":"5404b840-b86c-4383-85a4-1e6866ef06d2","Type":"ContainerStarted","Data":"6cc0ac34e043fd74ffccee9275c082e151334700dc0858ba16829086b6278b21"}
Jul 30 23:16:43.477109 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:43.476618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:16:43.494425 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:43.494362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6" podStartSLOduration=0.9975356 podStartE2EDuration="1.49434143s" totalImagesPullingTime="496.80583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:16:43.492873131 +0000 UTC m=+2200.554334529" watchObservedRunningTime="2026-07-30 23:16:43.49434143 +0000 UTC m=+2200.555802825"
Jul 30 23:16:49.488253 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:16:49.488216    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:17:06.232378 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:17:06.232337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:21.828784 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:17:21.828744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:06.560436 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.560397    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"]
Jul 30 23:18:06.561054 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.560638    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6" podUID="5404b840-b86c-4383-85a4-1e6866ef06d2" containerName="maas-api" containerID="cri-o://29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc" gracePeriod=30
Jul 30 23:18:06.588267 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.588230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:06.661433 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.661395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:06.725028 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.724971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:06.784608 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.784463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:06.830715 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.830686    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:18:06.878615 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.878538    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5404b840-b86c-4383-85a4-1e6866ef06d2-openshift-service-ca\") pod \"5404b840-b86c-4383-85a4-1e6866ef06d2\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") "
Jul 30 23:18:06.878615 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.878625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5404b840-b86c-4383-85a4-1e6866ef06d2-maas-api-tls\") pod \"5404b840-b86c-4383-85a4-1e6866ef06d2\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") "
Jul 30 23:18:06.878917 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.878698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qng9\" (UniqueName: \"kubernetes.io/projected/5404b840-b86c-4383-85a4-1e6866ef06d2-kube-api-access-6qng9\") pod \"5404b840-b86c-4383-85a4-1e6866ef06d2\" (UID: \"5404b840-b86c-4383-85a4-1e6866ef06d2\") "
Jul 30 23:18:06.878985 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.878929    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5404b840-b86c-4383-85a4-1e6866ef06d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5404b840-b86c-4383-85a4-1e6866ef06d2" (UID: "5404b840-b86c-4383-85a4-1e6866ef06d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:18:06.881057 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.881006    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5404b840-b86c-4383-85a4-1e6866ef06d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5404b840-b86c-4383-85a4-1e6866ef06d2" (UID: "5404b840-b86c-4383-85a4-1e6866ef06d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:18:06.881195 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.881092    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5404b840-b86c-4383-85a4-1e6866ef06d2-kube-api-access-6qng9" (OuterVolumeSpecName: "kube-api-access-6qng9") pod "5404b840-b86c-4383-85a4-1e6866ef06d2" (UID: "5404b840-b86c-4383-85a4-1e6866ef06d2"). InnerVolumeSpecName "kube-api-access-6qng9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:18:06.903707 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.903668    2565 generic.go:356] "Generic (PLEG): container finished" podID="5404b840-b86c-4383-85a4-1e6866ef06d2" containerID="29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc" exitCode=0
Jul 30 23:18:06.903914 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.903722    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"
Jul 30 23:18:06.903914 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.903759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6" event={"ID":"5404b840-b86c-4383-85a4-1e6866ef06d2","Type":"ContainerDied","Data":"29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc"}
Jul 30 23:18:06.903914 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.903828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6" event={"ID":"5404b840-b86c-4383-85a4-1e6866ef06d2","Type":"ContainerDied","Data":"6cc0ac34e043fd74ffccee9275c082e151334700dc0858ba16829086b6278b21"}
Jul 30 23:18:06.903914 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.903860    2565 scope.go:117] "RemoveContainer" containerID="29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc"
Jul 30 23:18:06.913785 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.913761    2565 scope.go:117] "RemoveContainer" containerID="29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc"
Jul 30 23:18:06.914130 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:18:06.914108    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc\": container with ID starting with 29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc not found: ID does not exist" containerID="29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc"
Jul 30 23:18:06.914180 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.914141    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc"} err="failed to get container status \"29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc\": rpc error: code = NotFound desc = could not find container \"29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc\": container with ID starting with 29e03c0f25b938a00825dd7f347c1b239b991d790e56019ab60f30f2e18bd6bc not found: ID does not exist"
Jul 30 23:18:06.925824 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.925784    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"]
Jul 30 23:18:06.927749 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.927719    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-604c6cd2-6bf5d987b5-jl9s6"]
Jul 30 23:18:06.980059 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.980012    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qng9\" (UniqueName: \"kubernetes.io/projected/5404b840-b86c-4383-85a4-1e6866ef06d2-kube-api-access-6qng9\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:18:06.980059 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.980049    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5404b840-b86c-4383-85a4-1e6866ef06d2-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:18:06.980059 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:06.980061    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5404b840-b86c-4383-85a4-1e6866ef06d2-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:18:07.469283 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:07.469248    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5404b840-b86c-4383-85a4-1e6866ef06d2" path="/var/lib/kubelet/pods/5404b840-b86c-4383-85a4-1e6866ef06d2/volumes"
Jul 30 23:18:10.146478 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:10.146430    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:15.176159 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:15.176126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:36.180806 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:36.180767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:44.951254 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:44.951215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:51.373595 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:51.373541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:52.047858 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:52.047826    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:57.796998 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:57.796924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:57.864817 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:57.864788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:58.119934 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:58.119843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:58.385073 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:18:58.385040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:09.730700 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:09.730659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:09.824699 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:09.824658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:09.923685 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:09.923651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:10.605362 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:10.605321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:10.709526 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:10.709497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:10.805866 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:10.805829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:12.163211 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:12.163161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:18.891191 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:18.891152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:18.996006 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:18.995972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:19.620717 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:19.620652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:25.781378 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:25.781337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:25.883353 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:25.883316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:25.983912 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:25.983847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:36.550789 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:36.550743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:36.796350 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:36.796306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:51.580256 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:51.580213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:51.680983 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:51.680948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:57.798725 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:19:57.798685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:03.608747 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.608714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:20:03.614056 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.614026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:20:03.616655 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.616628    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:20:03.619032 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.619005    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:20:03.622010 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.621989    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:20:03.626367 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.626346    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:20:03.684414 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.684367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:03.784324 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:03.784283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:04.048149 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:04.048113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:04.368034 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:04.367951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:05.033331 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:05.033291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:07.432737 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:07.432689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:08.633858 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.633815    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"]
Jul 30 23:20:08.634424 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.634409    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5404b840-b86c-4383-85a4-1e6866ef06d2" containerName="maas-api"
Jul 30 23:20:08.634477 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.634427    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5404b840-b86c-4383-85a4-1e6866ef06d2" containerName="maas-api"
Jul 30 23:20:08.634527 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.634515    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5404b840-b86c-4383-85a4-1e6866ef06d2" containerName="maas-api"
Jul 30 23:20:08.637949 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.637922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.640404 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.640382    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-fe64f5-serving-cert\""
Jul 30 23:20:08.648896 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.647913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"]
Jul 30 23:20:08.741862 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.741828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:08.779067 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.779023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81472ed-ab95-44e1-89d3-fbfa282b9298-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.779263 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.779097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpc5h\" (UniqueName: \"kubernetes.io/projected/f81472ed-ab95-44e1-89d3-fbfa282b9298-kube-api-access-jpc5h\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.779263 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.779239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.880294 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.880246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.880495 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.880340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81472ed-ab95-44e1-89d3-fbfa282b9298-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.880495 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.880380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpc5h\" (UniqueName: \"kubernetes.io/projected/f81472ed-ab95-44e1-89d3-fbfa282b9298-kube-api-access-jpc5h\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.880495 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:20:08.880403    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-serving-cert: secret "maas-api-e2e-inf-a-fe64f5-serving-cert" not found
Jul 30 23:20:08.880495 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:20:08.880471    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls podName:f81472ed-ab95-44e1-89d3-fbfa282b9298 nodeName:}" failed. No retries permitted until 2026-07-30 23:20:09.380454613 +0000 UTC m=+2406.441915987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls") pod "maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5" (UID: "f81472ed-ab95-44e1-89d3-fbfa282b9298") : secret "maas-api-e2e-inf-a-fe64f5-serving-cert" not found
Jul 30 23:20:08.881422 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.881394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81472ed-ab95-44e1-89d3-fbfa282b9298-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:08.891546 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:08.891462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpc5h\" (UniqueName: \"kubernetes.io/projected/f81472ed-ab95-44e1-89d3-fbfa282b9298-kube-api-access-jpc5h\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:09.005801 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:09.005760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:09.174091 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:09.173999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:09.278180 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:09.278139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:09.385624 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:09.385556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:09.388917 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:09.388884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls\") pod \"maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:09.554776 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:09.554670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:09.713024 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:09.712979    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"]
Jul 30 23:20:09.715989 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:20:09.715960    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81472ed_ab95_44e1_89d3_fbfa282b9298.slice/crio-db881aa3562ee9ca77a066b548c3b7ccf77098f841d42eca84e271ed4800cce5 WatchSource:0}: Error finding container db881aa3562ee9ca77a066b548c3b7ccf77098f841d42eca84e271ed4800cce5: Status 404 returned error can't find the container with id db881aa3562ee9ca77a066b548c3b7ccf77098f841d42eca84e271ed4800cce5
Jul 30 23:20:10.529698 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:10.529601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5" event={"ID":"f81472ed-ab95-44e1-89d3-fbfa282b9298","Type":"ContainerStarted","Data":"5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313"}
Jul 30 23:20:10.529698 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:10.529652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5" event={"ID":"f81472ed-ab95-44e1-89d3-fbfa282b9298","Type":"ContainerStarted","Data":"db881aa3562ee9ca77a066b548c3b7ccf77098f841d42eca84e271ed4800cce5"}
Jul 30 23:20:10.529905 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:10.529717    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:10.548498 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:10.548439    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5" podStartSLOduration=2.048741209 podStartE2EDuration="2.548421479s" totalImagesPullingTime="499.68027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:20:10.546975648 +0000 UTC m=+2407.608437044" watchObservedRunningTime="2026-07-30 23:20:10.548421479 +0000 UTC m=+2407.609882875"
Jul 30 23:20:16.541429 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:16.541392    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:20:32.452509 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:32.452418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:32.865220 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:32.865121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:33.153209 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:33.153168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:33.313158 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:33.313121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:36.548376 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:36.548334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:36.666679 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:36.666633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:37.647852 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.647794    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"]
Jul 30 23:20:37.651730 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.651702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.654990 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.654959    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-04f0cc-serving-cert\""
Jul 30 23:20:37.665981 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.665924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"]
Jul 30 23:20:37.691631 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.691566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:37.768760 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.768717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b15a7d-9002-4c19-86f2-5b18b1ce8181-openshift-service-ca\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.768962 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.768823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvpk2\" (UniqueName: \"kubernetes.io/projected/17b15a7d-9002-4c19-86f2-5b18b1ce8181-kube-api-access-nvpk2\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.768962 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.768859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b15a7d-9002-4c19-86f2-5b18b1ce8181-maas-api-tls\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.814063 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.814031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:37.870282 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.870241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b15a7d-9002-4c19-86f2-5b18b1ce8181-openshift-service-ca\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.870471 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.870310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvpk2\" (UniqueName: \"kubernetes.io/projected/17b15a7d-9002-4c19-86f2-5b18b1ce8181-kube-api-access-nvpk2\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.870471 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.870342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b15a7d-9002-4c19-86f2-5b18b1ce8181-maas-api-tls\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.870955 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.870933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b15a7d-9002-4c19-86f2-5b18b1ce8181-openshift-service-ca\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.873066 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.873039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b15a7d-9002-4c19-86f2-5b18b1ce8181-maas-api-tls\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.881681 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.881652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvpk2\" (UniqueName: \"kubernetes.io/projected/17b15a7d-9002-4c19-86f2-5b18b1ce8181-kube-api-access-nvpk2\") pod \"maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:37.966348 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:37.966237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:38.127000 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:38.126969    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"]
Jul 30 23:20:38.128839 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:20:38.128808    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b15a7d_9002_4c19_86f2_5b18b1ce8181.slice/crio-e9a3ca57427629fd204cb8dcc56d312d76448dad44ca9fe5bce8a9676afe0204 WatchSource:0}: Error finding container e9a3ca57427629fd204cb8dcc56d312d76448dad44ca9fe5bce8a9676afe0204: Status 404 returned error can't find the container with id e9a3ca57427629fd204cb8dcc56d312d76448dad44ca9fe5bce8a9676afe0204
Jul 30 23:20:38.211206 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:38.211171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:38.308865 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:38.308772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:38.674162 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:38.674124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c" event={"ID":"17b15a7d-9002-4c19-86f2-5b18b1ce8181","Type":"ContainerStarted","Data":"e9a3ca57427629fd204cb8dcc56d312d76448dad44ca9fe5bce8a9676afe0204"}
Jul 30 23:20:39.680893 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:39.680848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c" event={"ID":"17b15a7d-9002-4c19-86f2-5b18b1ce8181","Type":"ContainerStarted","Data":"eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d"}
Jul 30 23:20:39.681339 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:39.680940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:20:39.705735 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:39.705675    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c" podStartSLOduration=2.194772931 podStartE2EDuration="2.705656112s" totalImagesPullingTime="510.883181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:20:39.703879903 +0000 UTC m=+2436.765341316" watchObservedRunningTime="2026-07-30 23:20:39.705656112 +0000 UTC m=+2436.767117507"
Jul 30 23:20:45.693081 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:20:45.693042    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:21:01.577012 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:21:01.576961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:31.332029 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:21:31.331991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:51.948358 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:21:51.948322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:57.364611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:21:57.364501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:00.105139 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:00.105101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:42.147278 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:42.147244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:43.045847 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:43.045808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:53.752007 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:53.751949    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"]
Jul 30 23:22:53.752518 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:53.752258    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5" podUID="f81472ed-ab95-44e1-89d3-fbfa282b9298" containerName="maas-api" containerID="cri-o://5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313" gracePeriod=30
Jul 30 23:22:53.787323 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:53.787283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:53.887936 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:53.887900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:53.959862 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:53.959830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:54.220549 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.220520    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:22:54.351540 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.351428    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls\") pod \"f81472ed-ab95-44e1-89d3-fbfa282b9298\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") "
Jul 30 23:22:54.351540 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.351504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81472ed-ab95-44e1-89d3-fbfa282b9298-openshift-service-ca\") pod \"f81472ed-ab95-44e1-89d3-fbfa282b9298\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") "
Jul 30 23:22:54.351774 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.351690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpc5h\" (UniqueName: \"kubernetes.io/projected/f81472ed-ab95-44e1-89d3-fbfa282b9298-kube-api-access-jpc5h\") pod \"f81472ed-ab95-44e1-89d3-fbfa282b9298\" (UID: \"f81472ed-ab95-44e1-89d3-fbfa282b9298\") "
Jul 30 23:22:54.351925 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.351899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f81472ed-ab95-44e1-89d3-fbfa282b9298-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f81472ed-ab95-44e1-89d3-fbfa282b9298" (UID: "f81472ed-ab95-44e1-89d3-fbfa282b9298"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:22:54.352012 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.351993    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81472ed-ab95-44e1-89d3-fbfa282b9298-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:22:54.354001 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.353971    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f81472ed-ab95-44e1-89d3-fbfa282b9298" (UID: "f81472ed-ab95-44e1-89d3-fbfa282b9298"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:22:54.354114 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.354030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81472ed-ab95-44e1-89d3-fbfa282b9298-kube-api-access-jpc5h" (OuterVolumeSpecName: "kube-api-access-jpc5h") pod "f81472ed-ab95-44e1-89d3-fbfa282b9298" (UID: "f81472ed-ab95-44e1-89d3-fbfa282b9298"). InnerVolumeSpecName "kube-api-access-jpc5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:22:54.361651 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.361608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:54.382785 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.382745    2565 generic.go:356] "Generic (PLEG): container finished" podID="f81472ed-ab95-44e1-89d3-fbfa282b9298" containerID="5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313" exitCode=0
Jul 30 23:22:54.382785 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.382784    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"
Jul 30 23:22:54.382994 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.382835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5" event={"ID":"f81472ed-ab95-44e1-89d3-fbfa282b9298","Type":"ContainerDied","Data":"5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313"}
Jul 30 23:22:54.382994 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.382884    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5" event={"ID":"f81472ed-ab95-44e1-89d3-fbfa282b9298","Type":"ContainerDied","Data":"db881aa3562ee9ca77a066b548c3b7ccf77098f841d42eca84e271ed4800cce5"}
Jul 30 23:22:54.382994 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.382907    2565 scope.go:117] "RemoveContainer" containerID="5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313"
Jul 30 23:22:54.392968 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.392947    2565 scope.go:117] "RemoveContainer" containerID="5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313"
Jul 30 23:22:54.393268 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:22:54.393246    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313\": container with ID starting with 5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313 not found: ID does not exist" containerID="5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313"
Jul 30 23:22:54.393314 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.393277    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313"} err="failed to get container status \"5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313\": rpc error: code = NotFound desc = could not find container \"5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313\": container with ID starting with 5cde510a4bb27d419b09c383209042270edb633d5217800a9696419d44b86313 not found: ID does not exist"
Jul 30 23:22:54.403684 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.403652    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"]
Jul 30 23:22:54.407098 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.407060    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fe64f5-7c4946ff-k5sx5"]
Jul 30 23:22:54.452565 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.452527    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpc5h\" (UniqueName: \"kubernetes.io/projected/f81472ed-ab95-44e1-89d3-fbfa282b9298-kube-api-access-jpc5h\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:22:54.452565 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:54.452559    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81472ed-ab95-44e1-89d3-fbfa282b9298-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:22:55.470377 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:22:55.470341    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f81472ed-ab95-44e1-89d3-fbfa282b9298" path="/var/lib/kubelet/pods/f81472ed-ab95-44e1-89d3-fbfa282b9298/volumes"
Jul 30 23:23:00.387924 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:00.387887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:00.449875 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:00.449838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:00.766957 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:00.766859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:00.958359 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:00.958323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:11.452886 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.452842    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"]
Jul 30 23:23:11.453409 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.453166    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c" podUID="17b15a7d-9002-4c19-86f2-5b18b1ce8181" containerName="maas-api" containerID="cri-o://eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d" gracePeriod=30
Jul 30 23:23:11.480527 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.480496    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:11.582127 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.582092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:11.642603 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.642546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:11.701070 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.701034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:11.722740 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.722710    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:23:11.832434 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.832394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvpk2\" (UniqueName: \"kubernetes.io/projected/17b15a7d-9002-4c19-86f2-5b18b1ce8181-kube-api-access-nvpk2\") pod \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") "
Jul 30 23:23:11.832646 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.832531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b15a7d-9002-4c19-86f2-5b18b1ce8181-maas-api-tls\") pod \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") "
Jul 30 23:23:11.832646 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.832569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b15a7d-9002-4c19-86f2-5b18b1ce8181-openshift-service-ca\") pod \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\" (UID: \"17b15a7d-9002-4c19-86f2-5b18b1ce8181\") "
Jul 30 23:23:11.832975 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.832950    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17b15a7d-9002-4c19-86f2-5b18b1ce8181-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17b15a7d-9002-4c19-86f2-5b18b1ce8181" (UID: "17b15a7d-9002-4c19-86f2-5b18b1ce8181"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:23:11.834893 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.834864    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17b15a7d-9002-4c19-86f2-5b18b1ce8181-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17b15a7d-9002-4c19-86f2-5b18b1ce8181" (UID: "17b15a7d-9002-4c19-86f2-5b18b1ce8181"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:23:11.834893 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.834875    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b15a7d-9002-4c19-86f2-5b18b1ce8181-kube-api-access-nvpk2" (OuterVolumeSpecName: "kube-api-access-nvpk2") pod "17b15a7d-9002-4c19-86f2-5b18b1ce8181" (UID: "17b15a7d-9002-4c19-86f2-5b18b1ce8181"). InnerVolumeSpecName "kube-api-access-nvpk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:23:11.933493 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.933450    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvpk2\" (UniqueName: \"kubernetes.io/projected/17b15a7d-9002-4c19-86f2-5b18b1ce8181-kube-api-access-nvpk2\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:23:11.933493 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.933484    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b15a7d-9002-4c19-86f2-5b18b1ce8181-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:23:11.933493 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:11.933493    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b15a7d-9002-4c19-86f2-5b18b1ce8181-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:23:12.043922 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.043827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:12.475071 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.475031    2565 generic.go:356] "Generic (PLEG): container finished" podID="17b15a7d-9002-4c19-86f2-5b18b1ce8181" containerID="eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d" exitCode=0
Jul 30 23:23:12.475607 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.475081    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"
Jul 30 23:23:12.475607 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.475118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c" event={"ID":"17b15a7d-9002-4c19-86f2-5b18b1ce8181","Type":"ContainerDied","Data":"eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d"}
Jul 30 23:23:12.475607 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.475190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c" event={"ID":"17b15a7d-9002-4c19-86f2-5b18b1ce8181","Type":"ContainerDied","Data":"e9a3ca57427629fd204cb8dcc56d312d76448dad44ca9fe5bce8a9676afe0204"}
Jul 30 23:23:12.475607 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.475230    2565 scope.go:117] "RemoveContainer" containerID="eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d"
Jul 30 23:23:12.485074 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.485053    2565 scope.go:117] "RemoveContainer" containerID="eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d"
Jul 30 23:23:12.485383 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:23:12.485364    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d\": container with ID starting with eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d not found: ID does not exist" containerID="eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d"
Jul 30 23:23:12.485454 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.485393    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d"} err="failed to get container status \"eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d\": rpc error: code = NotFound desc = could not find container \"eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d\": container with ID starting with eaba1ccc3b784711e8c66d1412ff7868b98ad33ce5796eb1c60c2d955b9b874d not found: ID does not exist"
Jul 30 23:23:12.495330 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.495293    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"]
Jul 30 23:23:12.497628 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:12.497598    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04f0cc-757cd8d7bb-wnc6c"]
Jul 30 23:23:13.469968 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:13.469931    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17b15a7d-9002-4c19-86f2-5b18b1ce8181" path="/var/lib/kubelet/pods/17b15a7d-9002-4c19-86f2-5b18b1ce8181/volumes"
Jul 30 23:23:18.014783 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:18.014742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:18.094010 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:18.093947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:18.270316 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:18.270222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:18.513706 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:18.513668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:18.897530 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:18.897493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:19.223727 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:19.223624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:19.414004 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:19.413960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:22.522884 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:22.522830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:22.615013 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:22.614980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:23.845433 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.845390    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"]
Jul 30 23:23:23.846075 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.846044    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81472ed-ab95-44e1-89d3-fbfa282b9298" containerName="maas-api"
Jul 30 23:23:23.846075 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.846067    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81472ed-ab95-44e1-89d3-fbfa282b9298" containerName="maas-api"
Jul 30 23:23:23.846253 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.846114    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b15a7d-9002-4c19-86f2-5b18b1ce8181" containerName="maas-api"
Jul 30 23:23:23.846253 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.846123    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b15a7d-9002-4c19-86f2-5b18b1ce8181" containerName="maas-api"
Jul 30 23:23:23.846253 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.846222    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81472ed-ab95-44e1-89d3-fbfa282b9298" containerName="maas-api"
Jul 30 23:23:23.846253 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.846235    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="17b15a7d-9002-4c19-86f2-5b18b1ce8181" containerName="maas-api"
Jul 30 23:23:23.851271 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.851242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:23.853909 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.853882    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-356bb8-serving-cert\""
Jul 30 23:23:23.860964 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.860922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"]
Jul 30 23:23:23.882125 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.882081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:23.942226 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.942133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e01ee742-de87-467b-bd11-193605daa79f-maas-api-tls\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:23.942226 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.942196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwfk\" (UniqueName: \"kubernetes.io/projected/e01ee742-de87-467b-bd11-193605daa79f-kube-api-access-7vwfk\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:23.942466 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.942265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01ee742-de87-467b-bd11-193605daa79f-openshift-service-ca\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:23.982244 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:23.982208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:24.043243 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.043203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e01ee742-de87-467b-bd11-193605daa79f-maas-api-tls\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:24.043440 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.043266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vwfk\" (UniqueName: \"kubernetes.io/projected/e01ee742-de87-467b-bd11-193605daa79f-kube-api-access-7vwfk\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:24.043440 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.043292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01ee742-de87-467b-bd11-193605daa79f-openshift-service-ca\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:24.044006 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.043985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01ee742-de87-467b-bd11-193605daa79f-openshift-service-ca\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:24.045993 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.045968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e01ee742-de87-467b-bd11-193605daa79f-maas-api-tls\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:24.051152 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.051122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vwfk\" (UniqueName: \"kubernetes.io/projected/e01ee742-de87-467b-bd11-193605daa79f-kube-api-access-7vwfk\") pod \"maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:24.164485 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.164449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:24.323159 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.323090    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"]
Jul 30 23:23:24.326176 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:23:24.326143    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01ee742_de87_467b_bd11_193605daa79f.slice/crio-d11f9978fb11e6c1d048fa49c500595fe814434259073d7ce2f8066fefa4bd6e WatchSource:0}: Error finding container d11f9978fb11e6c1d048fa49c500595fe814434259073d7ce2f8066fefa4bd6e: Status 404 returned error can't find the container with id d11f9978fb11e6c1d048fa49c500595fe814434259073d7ce2f8066fefa4bd6e
Jul 30 23:23:24.327564 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.327541    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:23:24.345477 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.345442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:24.439846 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.439757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:24.535829 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:24.535796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n" event={"ID":"e01ee742-de87-467b-bd11-193605daa79f","Type":"ContainerStarted","Data":"d11f9978fb11e6c1d048fa49c500595fe814434259073d7ce2f8066fefa4bd6e"}
Jul 30 23:23:25.542119 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:25.542082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n" event={"ID":"e01ee742-de87-467b-bd11-193605daa79f","Type":"ContainerStarted","Data":"80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96"}
Jul 30 23:23:25.542663 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:25.542183    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:25.564795 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:25.560482    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n" podStartSLOduration=2.089157748 podStartE2EDuration="2.560458885s" totalImagesPullingTime="471.301137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:23:25.556931126 +0000 UTC m=+2602.618392533" watchObservedRunningTime="2026-07-30 23:23:25.560458885 +0000 UTC m=+2602.621920282"
Jul 30 23:23:31.553260 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:31.553222    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:23:47.591235 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:47.591201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:48.089916 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:48.089880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:48.420627 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:48.420569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:48.599227 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:48.599187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:51.742446 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:51.742405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:51.838103 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:51.838067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:52.814908 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.814869    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"]
Jul 30 23:23:52.818701 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.818675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:52.821480 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.821437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1ed561-serving-cert\""
Jul 30 23:23:52.830497 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.830434    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"]
Jul 30 23:23:52.847528 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.847493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:52.933202 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.933154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxqds\" (UniqueName: \"kubernetes.io/projected/c960370c-c5cb-4110-8db9-8ca01cbb619e-kube-api-access-dxqds\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:52.933411 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.933344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c960370c-c5cb-4110-8db9-8ca01cbb619e-openshift-service-ca\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:52.933461 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:52.933428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c960370c-c5cb-4110-8db9-8ca01cbb619e-maas-api-tls\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.034373 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.034324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxqds\" (UniqueName: \"kubernetes.io/projected/c960370c-c5cb-4110-8db9-8ca01cbb619e-kube-api-access-dxqds\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.034641 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.034471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c960370c-c5cb-4110-8db9-8ca01cbb619e-openshift-service-ca\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.034641 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.034526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c960370c-c5cb-4110-8db9-8ca01cbb619e-maas-api-tls\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.035166 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.035142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c960370c-c5cb-4110-8db9-8ca01cbb619e-openshift-service-ca\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.037311 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.037288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c960370c-c5cb-4110-8db9-8ca01cbb619e-maas-api-tls\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.043099 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.043073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxqds\" (UniqueName: \"kubernetes.io/projected/c960370c-c5cb-4110-8db9-8ca01cbb619e-kube-api-access-dxqds\") pod \"maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.058175 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.058136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:53.137188 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.137151    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:53.284118 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.284086    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"]
Jul 30 23:23:53.286993 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:23:53.286954    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc960370c_c5cb_4110_8db9_8ca01cbb619e.slice/crio-e9879952726053be94a164d857b32f1c468468ce7e0326d17298476cf4501dd7 WatchSource:0}: Error finding container e9879952726053be94a164d857b32f1c468468ce7e0326d17298476cf4501dd7: Status 404 returned error can't find the container with id e9879952726053be94a164d857b32f1c468468ce7e0326d17298476cf4501dd7
Jul 30 23:23:53.439118 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.438988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:53.545718 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.545682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:53.686520 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:53.686487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2" event={"ID":"c960370c-c5cb-4110-8db9-8ca01cbb619e","Type":"ContainerStarted","Data":"e9879952726053be94a164d857b32f1c468468ce7e0326d17298476cf4501dd7"}
Jul 30 23:23:54.692642 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:54.692572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2" event={"ID":"c960370c-c5cb-4110-8db9-8ca01cbb619e","Type":"ContainerStarted","Data":"19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770"}
Jul 30 23:23:54.693096 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:54.692665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:23:54.708829 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:23:54.708773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2" podStartSLOduration=2.351233428 podStartE2EDuration="2.708755461s" totalImagesPullingTime="357.522033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:23:54.708145883 +0000 UTC m=+2631.769607283" watchObservedRunningTime="2026-07-30 23:23:54.708755461 +0000 UTC m=+2631.770216857"
Jul 30 23:24:00.704232 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:00.704195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:24:16.793995 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:16.793965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:35.214931 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.214891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:35.319817 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.319773    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"]
Jul 30 23:24:35.320033 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.320001    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n" podUID="e01ee742-de87-467b-bd11-193605daa79f" containerName="maas-api" containerID="cri-o://80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96" gracePeriod=30
Jul 30 23:24:35.340968 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.340939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:35.407388 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.407338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:35.508146 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.508109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:35.586278 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.586253    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:24:35.637248 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.637213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:35.749790 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.749690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e01ee742-de87-467b-bd11-193605daa79f-maas-api-tls\") pod \"e01ee742-de87-467b-bd11-193605daa79f\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") "
Jul 30 23:24:35.749790 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.749771    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01ee742-de87-467b-bd11-193605daa79f-openshift-service-ca\") pod \"e01ee742-de87-467b-bd11-193605daa79f\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") "
Jul 30 23:24:35.750026 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.749817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vwfk\" (UniqueName: \"kubernetes.io/projected/e01ee742-de87-467b-bd11-193605daa79f-kube-api-access-7vwfk\") pod \"e01ee742-de87-467b-bd11-193605daa79f\" (UID: \"e01ee742-de87-467b-bd11-193605daa79f\") "
Jul 30 23:24:35.750177 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.750146    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01ee742-de87-467b-bd11-193605daa79f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e01ee742-de87-467b-bd11-193605daa79f" (UID: "e01ee742-de87-467b-bd11-193605daa79f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:24:35.752160 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.752135    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e01ee742-de87-467b-bd11-193605daa79f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e01ee742-de87-467b-bd11-193605daa79f" (UID: "e01ee742-de87-467b-bd11-193605daa79f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:24:35.752160 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.752153    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01ee742-de87-467b-bd11-193605daa79f-kube-api-access-7vwfk" (OuterVolumeSpecName: "kube-api-access-7vwfk") pod "e01ee742-de87-467b-bd11-193605daa79f" (UID: "e01ee742-de87-467b-bd11-193605daa79f"). InnerVolumeSpecName "kube-api-access-7vwfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:24:35.850897 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.850852    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e01ee742-de87-467b-bd11-193605daa79f-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:24:35.850897 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.850886    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01ee742-de87-467b-bd11-193605daa79f-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:24:35.850897 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.850897    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vwfk\" (UniqueName: \"kubernetes.io/projected/e01ee742-de87-467b-bd11-193605daa79f-kube-api-access-7vwfk\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:24:35.901342 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.901301    2565 generic.go:356] "Generic (PLEG): container finished" podID="e01ee742-de87-467b-bd11-193605daa79f" containerID="80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96" exitCode=0
Jul 30 23:24:35.901528 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.901359    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"
Jul 30 23:24:35.901528 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.901397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n" event={"ID":"e01ee742-de87-467b-bd11-193605daa79f","Type":"ContainerDied","Data":"80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96"}
Jul 30 23:24:35.901528 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.901488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n" event={"ID":"e01ee742-de87-467b-bd11-193605daa79f","Type":"ContainerDied","Data":"d11f9978fb11e6c1d048fa49c500595fe814434259073d7ce2f8066fefa4bd6e"}
Jul 30 23:24:35.901528 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.901513    2565 scope.go:117] "RemoveContainer" containerID="80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96"
Jul 30 23:24:35.911416 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.911396    2565 scope.go:117] "RemoveContainer" containerID="80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96"
Jul 30 23:24:35.911869 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:24:35.911848    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96\": container with ID starting with 80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96 not found: ID does not exist" containerID="80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96"
Jul 30 23:24:35.911935 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.911889    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96"} err="failed to get container status \"80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96\": rpc error: code = NotFound desc = could not find container \"80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96\": container with ID starting with 80f3cc60bf622243a193da1a15a31a036f2957c45970245c47448644baacda96 not found: ID does not exist"
Jul 30 23:24:35.922735 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.922694    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"]
Jul 30 23:24:35.926124 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.926087    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-356bb8-64f96dd9c4-5wz9n"]
Jul 30 23:24:35.932421 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:35.932390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:37.470478 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:37.470437    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e01ee742-de87-467b-bd11-193605daa79f" path="/var/lib/kubelet/pods/e01ee742-de87-467b-bd11-193605daa79f/volumes"
Jul 30 23:24:41.800035 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:41.800001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:41.900323 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:41.900286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:42.076276 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:42.076190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:42.320902 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:42.320870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:58.088195 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.088088    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"]
Jul 30 23:24:58.088708 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.088403    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2" podUID="c960370c-c5cb-4110-8db9-8ca01cbb619e" containerName="maas-api" containerID="cri-o://19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770" gracePeriod=30
Jul 30 23:24:58.111303 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.111271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:58.176652 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.176618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:58.236712 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.236673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:58.295244 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.295116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:58.356145 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.356117    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:24:58.477294 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.477247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c960370c-c5cb-4110-8db9-8ca01cbb619e-openshift-service-ca\") pod \"c960370c-c5cb-4110-8db9-8ca01cbb619e\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") "
Jul 30 23:24:58.477533 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.477316    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxqds\" (UniqueName: \"kubernetes.io/projected/c960370c-c5cb-4110-8db9-8ca01cbb619e-kube-api-access-dxqds\") pod \"c960370c-c5cb-4110-8db9-8ca01cbb619e\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") "
Jul 30 23:24:58.477533 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.477360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c960370c-c5cb-4110-8db9-8ca01cbb619e-maas-api-tls\") pod \"c960370c-c5cb-4110-8db9-8ca01cbb619e\" (UID: \"c960370c-c5cb-4110-8db9-8ca01cbb619e\") "
Jul 30 23:24:58.477815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.477785    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c960370c-c5cb-4110-8db9-8ca01cbb619e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c960370c-c5cb-4110-8db9-8ca01cbb619e" (UID: "c960370c-c5cb-4110-8db9-8ca01cbb619e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:24:58.478234 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.478205    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c960370c-c5cb-4110-8db9-8ca01cbb619e-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:24:58.480103 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.480070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c960370c-c5cb-4110-8db9-8ca01cbb619e-kube-api-access-dxqds" (OuterVolumeSpecName: "kube-api-access-dxqds") pod "c960370c-c5cb-4110-8db9-8ca01cbb619e" (UID: "c960370c-c5cb-4110-8db9-8ca01cbb619e"). InnerVolumeSpecName "kube-api-access-dxqds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:24:58.480210 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.480091    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c960370c-c5cb-4110-8db9-8ca01cbb619e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c960370c-c5cb-4110-8db9-8ca01cbb619e" (UID: "c960370c-c5cb-4110-8db9-8ca01cbb619e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:24:58.580264 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.580220    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxqds\" (UniqueName: \"kubernetes.io/projected/c960370c-c5cb-4110-8db9-8ca01cbb619e-kube-api-access-dxqds\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:24:58.580264 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.580265    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c960370c-c5cb-4110-8db9-8ca01cbb619e-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:24:58.687701 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:58.687634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:59.014999 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.014900    2565 generic.go:356] "Generic (PLEG): container finished" podID="c960370c-c5cb-4110-8db9-8ca01cbb619e" containerID="19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770" exitCode=0
Jul 30 23:24:59.014999 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.014965    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"
Jul 30 23:24:59.014999 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.014985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2" event={"ID":"c960370c-c5cb-4110-8db9-8ca01cbb619e","Type":"ContainerDied","Data":"19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770"}
Jul 30 23:24:59.015244 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.015043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2" event={"ID":"c960370c-c5cb-4110-8db9-8ca01cbb619e","Type":"ContainerDied","Data":"e9879952726053be94a164d857b32f1c468468ce7e0326d17298476cf4501dd7"}
Jul 30 23:24:59.015244 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.015067    2565 scope.go:117] "RemoveContainer" containerID="19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770"
Jul 30 23:24:59.024909 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.024888    2565 scope.go:117] "RemoveContainer" containerID="19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770"
Jul 30 23:24:59.025209 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:24:59.025186    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770\": container with ID starting with 19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770 not found: ID does not exist" containerID="19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770"
Jul 30 23:24:59.025286 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.025217    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770"} err="failed to get container status \"19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770\": rpc error: code = NotFound desc = could not find container \"19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770\": container with ID starting with 19608e3bc8136d9a49ddcd54ef4474ce6960ef7c557ab42a4393541959bd3770 not found: ID does not exist"
Jul 30 23:24:59.035783 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.035751    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"]
Jul 30 23:24:59.041968 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.041934    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1ed561-76c95cf77f-f9tr2"]
Jul 30 23:24:59.470271 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:24:59.470237    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c960370c-c5cb-4110-8db9-8ca01cbb619e" path="/var/lib/kubelet/pods/c960370c-c5cb-4110-8db9-8ca01cbb619e/volumes"
Jul 30 23:25:03.641329 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:03.641301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:25:03.646717 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:03.646691    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:25:03.648957 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:03.648930    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:25:03.651746 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:03.651726    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:25:03.654187 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:03.654164    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:25:03.658742 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:03.658722    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:25:04.347368 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:04.347332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:04.441047 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:04.440999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:04.650893 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:04.650858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:04.893853 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:04.893819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:05.264752 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:05.264714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:05.594279 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:05.594180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:05.743820 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:05.743782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:08.201294 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:08.201252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:08.296329 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:08.296295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:09.430675 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.430635    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"]
Jul 30 23:25:09.431260 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.431241    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01ee742-de87-467b-bd11-193605daa79f" containerName="maas-api"
Jul 30 23:25:09.431260 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.431262    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01ee742-de87-467b-bd11-193605daa79f" containerName="maas-api"
Jul 30 23:25:09.431404 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.431280    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c960370c-c5cb-4110-8db9-8ca01cbb619e" containerName="maas-api"
Jul 30 23:25:09.431404 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.431287    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c960370c-c5cb-4110-8db9-8ca01cbb619e" containerName="maas-api"
Jul 30 23:25:09.431404 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.431374    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01ee742-de87-467b-bd11-193605daa79f" containerName="maas-api"
Jul 30 23:25:09.431404 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.431386    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c960370c-c5cb-4110-8db9-8ca01cbb619e" containerName="maas-api"
Jul 30 23:25:09.436450 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.436424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.438983 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.438952    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-80952f-serving-cert\""
Jul 30 23:25:09.444206 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.444154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"]
Jul 30 23:25:09.469415 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.469368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:09.590525 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.590484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90dbeb39-3ad1-4866-9ffc-46b6898d3953-maas-api-tls\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.590728 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.590543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90dbeb39-3ad1-4866-9ffc-46b6898d3953-openshift-service-ca\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.590728 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.590680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgm6v\" (UniqueName: \"kubernetes.io/projected/90dbeb39-3ad1-4866-9ffc-46b6898d3953-kube-api-access-jgm6v\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.692100 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.691992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90dbeb39-3ad1-4866-9ffc-46b6898d3953-maas-api-tls\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.692100 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.692060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90dbeb39-3ad1-4866-9ffc-46b6898d3953-openshift-service-ca\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.692100 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.692100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgm6v\" (UniqueName: \"kubernetes.io/projected/90dbeb39-3ad1-4866-9ffc-46b6898d3953-kube-api-access-jgm6v\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.692835 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.692771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90dbeb39-3ad1-4866-9ffc-46b6898d3953-openshift-service-ca\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.694682 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.694658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90dbeb39-3ad1-4866-9ffc-46b6898d3953-maas-api-tls\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.699871 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.699842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgm6v\" (UniqueName: \"kubernetes.io/projected/90dbeb39-3ad1-4866-9ffc-46b6898d3953-kube-api-access-jgm6v\") pod \"maas-api-e2e-shared-a-80952f-644847bfc5-zc54q\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.751982 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.751947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:09.904714 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:09.904684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"]
Jul 30 23:25:09.907910 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:25:09.907871    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90dbeb39_3ad1_4866_9ffc_46b6898d3953.slice/crio-5042281c895016484d3ecf2600408e0ffd34bb875aeb68aefda680f7d67f0008 WatchSource:0}: Error finding container 5042281c895016484d3ecf2600408e0ffd34bb875aeb68aefda680f7d67f0008: Status 404 returned error can't find the container with id 5042281c895016484d3ecf2600408e0ffd34bb875aeb68aefda680f7d67f0008
Jul 30 23:25:10.073901 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:10.073808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q" event={"ID":"90dbeb39-3ad1-4866-9ffc-46b6898d3953","Type":"ContainerStarted","Data":"5042281c895016484d3ecf2600408e0ffd34bb875aeb68aefda680f7d67f0008"}
Jul 30 23:25:10.840524 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:10.840488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:11.080686 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:11.080647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q" event={"ID":"90dbeb39-3ad1-4866-9ffc-46b6898d3953","Type":"ContainerStarted","Data":"8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55"}
Jul 30 23:25:11.080881 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:11.080819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:11.098321 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:11.098201    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q" podStartSLOduration=1.694118514 podStartE2EDuration="2.098179907s" totalImagesPullingTime="404.061393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:25:11.095655167 +0000 UTC m=+2708.157116563" watchObservedRunningTime="2026-07-30 23:25:11.098179907 +0000 UTC m=+2708.159641303"
Jul 30 23:25:17.091350 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:17.091316    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:25:29.769544 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:29.769506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:33.225813 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:33.225772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:33.592937 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:33.592849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:33.911962 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:33.911929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:34.245329 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:34.245242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:37.356239 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:37.356200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:37.488079 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:37.488045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:38.456534 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.456493    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"]
Jul 30 23:25:38.461774 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.461739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.464329 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.464299    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bb1098-serving-cert\""
Jul 30 23:25:38.471064 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.471008    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"]
Jul 30 23:25:38.495424 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.495381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:38.586709 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.586653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c216a02-fb82-483b-adef-6fe3523cceb0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.586942 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.586820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdkmm\" (UniqueName: \"kubernetes.io/projected/9c216a02-fb82-483b-adef-6fe3523cceb0-kube-api-access-mdkmm\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.586942 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.586913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.687702 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.687651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdkmm\" (UniqueName: \"kubernetes.io/projected/9c216a02-fb82-483b-adef-6fe3523cceb0-kube-api-access-mdkmm\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.687950 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.687753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.687950 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.687855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c216a02-fb82-483b-adef-6fe3523cceb0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.687950 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:25:38.687900    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-serving-cert: secret "maas-api-e2e-shared-b-bb1098-serving-cert" not found
Jul 30 23:25:38.688090 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:25:38.687991    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls podName:9c216a02-fb82-483b-adef-6fe3523cceb0 nodeName:}" failed. No retries permitted until 2026-07-30 23:25:39.187974092 +0000 UTC m=+2736.249435467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls") pod "maas-api-e2e-shared-b-bb1098-649fd67454-v99f8" (UID: "9c216a02-fb82-483b-adef-6fe3523cceb0") : secret "maas-api-e2e-shared-b-bb1098-serving-cert" not found
Jul 30 23:25:38.688717 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.688685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c216a02-fb82-483b-adef-6fe3523cceb0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.699481 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.699450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdkmm\" (UniqueName: \"kubernetes.io/projected/9c216a02-fb82-483b-adef-6fe3523cceb0-kube-api-access-mdkmm\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:38.931636 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:38.931558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:39.030668 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:39.030630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:39.115483 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:39.115445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:39.192847 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:39.192570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:39.196215 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:39.196180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb1098-649fd67454-v99f8\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:39.377904 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:39.377867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:39.536120 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:39.536080    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"]
Jul 30 23:25:39.538916 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:25:39.538882    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c216a02_fb82_483b_adef_6fe3523cceb0.slice/crio-dfee0182453959859d434bc27d7b0c5206a49d036b88ee3bb713847b7c7c8a87 WatchSource:0}: Error finding container dfee0182453959859d434bc27d7b0c5206a49d036b88ee3bb713847b7c7c8a87: Status 404 returned error can't find the container with id dfee0182453959859d434bc27d7b0c5206a49d036b88ee3bb713847b7c7c8a87
Jul 30 23:25:40.231020 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:40.230975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8" event={"ID":"9c216a02-fb82-483b-adef-6fe3523cceb0","Type":"ContainerStarted","Data":"fbd4c2f069a5def85837ec1f8d42de1b56d13d5877b83d3d60f9b76c61d972a8"}
Jul 30 23:25:40.231209 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:40.231174    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:25:40.231254 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:40.231205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8" event={"ID":"9c216a02-fb82-483b-adef-6fe3523cceb0","Type":"ContainerStarted","Data":"dfee0182453959859d434bc27d7b0c5206a49d036b88ee3bb713847b7c7c8a87"}
Jul 30 23:25:40.249599 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:40.249525    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8" podStartSLOduration=1.75244588 podStartE2EDuration="2.249508291s" totalImagesPullingTime="497.062411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:25:40.247145634 +0000 UTC m=+2737.308607049" watchObservedRunningTime="2026-07-30 23:25:40.249508291 +0000 UTC m=+2737.310969686"
Jul 30 23:25:46.241904 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:25:46.241873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:26:02.398520 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:26:02.398470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:21.630961 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:26:21.630925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:38.440488 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:26:38.440407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:28:10.435047 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:28:10.434955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:28:15.224098 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:28:15.224063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:28:59.332804 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:28:59.332761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:28:59.389500 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:28:59.389441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:06.457800 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:29:06.457762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:06.556736 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:29:06.556702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:00.149285 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.149247    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672"]
Jul 30 23:30:00.152874 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.152851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672"
Jul 30 23:30:00.160063 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.159721    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:30:00.163030 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.163014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672"
Jul 30 23:30:00.183055 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.183017    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672"]
Jul 30 23:30:00.314643 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.314612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672"]
Jul 30 23:30:00.317255 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:30:00.317225    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfba43c_9635_45a3_8d8e_6d41795c135a.slice/crio-9a9e0166deaa8bd2c24af2a2570785288c8d7d3bc0f36acd3f991851db45cfed WatchSource:0}: Error finding container 9a9e0166deaa8bd2c24af2a2570785288c8d7d3bc0f36acd3f991851db45cfed: Status 404 returned error can't find the container with id 9a9e0166deaa8bd2c24af2a2570785288c8d7d3bc0f36acd3f991851db45cfed
Jul 30 23:30:00.319191 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.319172    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:30:00.501255 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:00.501162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672" event={"ID":"acfba43c-9635-45a3-8d8e-6d41795c135a","Type":"ContainerStarted","Data":"9a9e0166deaa8bd2c24af2a2570785288c8d7d3bc0f36acd3f991851db45cfed"}
Jul 30 23:30:02.805472 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:02.805429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:03.518970 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.518934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672" event={"ID":"acfba43c-9635-45a3-8d8e-6d41795c135a","Type":"ContainerStarted","Data":"b45e8cb9d1da28f81372d5aa4883cb93ccfdc26a0fc3403d041ef537cd6ea6ce"}
Jul 30 23:30:03.535329 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.535280    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672" podStartSLOduration=1.151818242 podStartE2EDuration="3.535262967s" totalImagesPullingTime="2.383444725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:03.533558339 +0000 UTC m=+3000.595019736" watchObservedRunningTime="2026-07-30 23:30:03.535262967 +0000 UTC m=+3000.596724411"
Jul 30 23:30:03.639751 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:30:03.639719    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfba43c_9635_45a3_8d8e_6d41795c135a.slice/crio-conmon-b45e8cb9d1da28f81372d5aa4883cb93ccfdc26a0fc3403d041ef537cd6ea6ce.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 23:30:03.673689 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.673657    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:30:03.678564 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.678537    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:30:03.680935 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.680889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:30:03.693705 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.692564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:30:03.700181 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.700154    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:30:03.708730 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.708709    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:30:03.719565 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:03.719536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:04.525626 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:04.525565    2565 generic.go:356] "Generic (PLEG): container finished" podID="acfba43c-9635-45a3-8d8e-6d41795c135a" containerID="b45e8cb9d1da28f81372d5aa4883cb93ccfdc26a0fc3403d041ef537cd6ea6ce" exitCode=0
Jul 30 23:30:04.525626 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:04.525603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672" event={"ID":"acfba43c-9635-45a3-8d8e-6d41795c135a","Type":"ContainerDied","Data":"b45e8cb9d1da28f81372d5aa4883cb93ccfdc26a0fc3403d041ef537cd6ea6ce"}
Jul 30 23:30:05.660546 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:05.660521    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672"
Jul 30 23:30:06.537866 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:06.537835    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672"
Jul 30 23:30:06.538046 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:06.537866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-6z672" event={"ID":"acfba43c-9635-45a3-8d8e-6d41795c135a","Type":"ContainerDied","Data":"9a9e0166deaa8bd2c24af2a2570785288c8d7d3bc0f36acd3f991851db45cfed"}
Jul 30 23:30:06.538046 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:06.537915    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a9e0166deaa8bd2c24af2a2570785288c8d7d3bc0f36acd3f991851db45cfed"
Jul 30 23:30:10.396070 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:10.396034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:37.830443 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:30:37.830404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:48.209020 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:31:48.208972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:54.798702 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:31:54.798657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:55.732451 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:31:55.732408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:07.800535 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:32:07.800497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:50.834207 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:32:50.834169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:33:58.730841 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:33:58.730746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:33:59.546480 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:33:59.546432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:19.159257 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:19.159225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:19.472615 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:19.472515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:19.774763 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:19.774668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:22.433912 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:22.433880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:22.539641 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:22.539604    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:23.498401 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.498366    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"]
Jul 30 23:34:23.498979 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.498962    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfba43c-9635-45a3-8d8e-6d41795c135a" containerName="cleanup"
Jul 30 23:34:23.499030 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.498981    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfba43c-9635-45a3-8d8e-6d41795c135a" containerName="cleanup"
Jul 30 23:34:23.499127 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.499116    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfba43c-9635-45a3-8d8e-6d41795c135a" containerName="cleanup"
Jul 30 23:34:23.502784 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.502761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.505323 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.505301    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-287423-serving-cert\""
Jul 30 23:34:23.513006 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.512973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"]
Jul 30 23:34:23.536250 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.536220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:23.537395 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.537366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8dqb\" (UniqueName: \"kubernetes.io/projected/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-kube-api-access-f8dqb\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.537536 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.537416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.537536 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.537473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.638058 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.638019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dqb\" (UniqueName: \"kubernetes.io/projected/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-kube-api-access-f8dqb\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.638267 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.638088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.638267 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.638128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.638369 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:34:23.638270    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-serving-cert: secret "maas-api-e2e-ipp-a-287423-serving-cert" not found
Jul 30 23:34:23.638369 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:34:23.638353    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls podName:820f7f71-8a94-4b7d-8047-8a2d96fa29ce nodeName:}" failed. No retries permitted until 2026-07-30 23:34:24.138330377 +0000 UTC m=+3261.199791756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls") pod "maas-api-e2e-ipp-a-287423-665cb79df9-rws68" (UID: "820f7f71-8a94-4b7d-8047-8a2d96fa29ce") : secret "maas-api-e2e-ipp-a-287423-serving-cert" not found
Jul 30 23:34:23.638852 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.638832    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.653103 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.653077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8dqb\" (UniqueName: \"kubernetes.io/projected/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-kube-api-access-f8dqb\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:23.776046 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:23.775957    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:24.126929 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:24.126851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:24.142388 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:24.142356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:24.145126 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:24.145098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls\") pod \"maas-api-e2e-ipp-a-287423-665cb79df9-rws68\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:24.231522 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:24.231470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:24.415526 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:24.415495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:24.556995 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:24.556959    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"]
Jul 30 23:34:24.559966 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:34:24.559940    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820f7f71_8a94_4b7d_8047_8a2d96fa29ce.slice/crio-399a54d4996cde38e161255579b48d44f1c6fbbd2a241116cae60b783a1f9d67 WatchSource:0}: Error finding container 399a54d4996cde38e161255579b48d44f1c6fbbd2a241116cae60b783a1f9d67: Status 404 returned error can't find the container with id 399a54d4996cde38e161255579b48d44f1c6fbbd2a241116cae60b783a1f9d67
Jul 30 23:34:24.802929 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:24.802837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68" event={"ID":"820f7f71-8a94-4b7d-8047-8a2d96fa29ce","Type":"ContainerStarted","Data":"399a54d4996cde38e161255579b48d44f1c6fbbd2a241116cae60b783a1f9d67"}
Jul 30 23:34:25.809476 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:25.809444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68" event={"ID":"820f7f71-8a94-4b7d-8047-8a2d96fa29ce","Type":"ContainerStarted","Data":"5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7"}
Jul 30 23:34:25.809884 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:25.809509    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:25.826388 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:25.826324    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68" podStartSLOduration=1.762156868 podStartE2EDuration="2.826303106s" totalImagesPullingTime="1.064146238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:34:25.825808132 +0000 UTC m=+3262.887269525" watchObservedRunningTime="2026-07-30 23:34:25.826303106 +0000 UTC m=+3262.887764501"
Jul 30 23:34:31.819443 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:31.819411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:34:48.319189 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:48.319129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:58.358353 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.358309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:58.664517 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.664476    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"]
Jul 30 23:34:58.670156 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.670118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"]
Jul 30 23:34:58.670302 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.670245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.672699 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.672675    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-02337c-openshift-default-dockercfg-5sngp\""
Jul 30 23:34:58.678263 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.678239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:58.694537 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-credential-socket\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694721 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-certs\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694721 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-envoy\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694721 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-socket\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694721 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-data\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694940 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-token\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694940 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-podinfo\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694940 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istiod-ca-cert\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.694940 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.694850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44ggs\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-kube-api-access-44ggs\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.795923 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.795878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-credential-socket\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796136 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.795931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-certs\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796136 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-envoy\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796136 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-socket\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796136 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-data\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796345 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-token\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796345 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-podinfo\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796345 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istiod-ca-cert\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796345 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44ggs\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-kube-api-access-44ggs\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796545 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-certs\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796545 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-credential-socket\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796674 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-data\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.796740 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.796721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-socket\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.797046 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.797027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istiod-ca-cert\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.798680 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.798660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-envoy\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.798983 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.798960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-podinfo\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.803775 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.803754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-token\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.803984 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.803966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44ggs\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-kube-api-access-44ggs\") pod \"e2e-ipp-b-02337c-openshift-default-766dd99556-24khp\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") " pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:58.965867 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.965784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:34:58.983082 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:58.983051    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:34:59.127642 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:59.127617    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"]
Jul 30 23:34:59.130058 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:34:59.130026    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee97fa12_fb26_4319_91ba_ed98b8fe92a0.slice/crio-d03ba64401766c9f8bb952083891d3e584f289d1a136ae31fa1be901019ba3c0 WatchSource:0}: Error finding container d03ba64401766c9f8bb952083891d3e584f289d1a136ae31fa1be901019ba3c0: Status 404 returned error can't find the container with id d03ba64401766c9f8bb952083891d3e584f289d1a136ae31fa1be901019ba3c0
Jul 30 23:34:59.132713 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:59.132679    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 23:34:59.132806 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:59.132755    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 23:34:59.132806 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:59.132790    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 23:34:59.980079 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:59.980033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" event={"ID":"ee97fa12-fb26-4319-91ba-ed98b8fe92a0","Type":"ContainerStarted","Data":"a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a"}
Jul 30 23:34:59.980478 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:59.980104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" event={"ID":"ee97fa12-fb26-4319-91ba-ed98b8fe92a0","Type":"ContainerStarted","Data":"d03ba64401766c9f8bb952083891d3e584f289d1a136ae31fa1be901019ba3c0"}
Jul 30 23:34:59.983409 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:34:59.983389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:00.001490 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:00.001438    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podStartSLOduration=2.001421731 podStartE2EDuration="2.001421731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:35:00.000222812 +0000 UTC m=+3297.061684233" watchObservedRunningTime="2026-07-30 23:35:00.001421731 +0000 UTC m=+3297.062883125"
Jul 30 23:35:00.989428 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:00.989398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:01.953437 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:01.953395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:35:01.991104 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:01.991072    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:01.992185 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:01.992167    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:02.050222 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:02.050185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:35:03.096742 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.096709    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"]
Jul 30 23:35:03.100652 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.100632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.103645 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.103620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-02337c-serving-cert\""
Jul 30 23:35:03.120964 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.120919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"]
Jul 30 23:35:03.137461 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.137425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:35:03.146792 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.146757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xs8\" (UniqueName: \"kubernetes.io/projected/eea8c8bd-06c5-44e5-9b38-bf527be99636-kube-api-access-z8xs8\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.147003 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.146911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.147068 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.147001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea8c8bd-06c5-44e5-9b38-bf527be99636-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.248233 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.248188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.248443 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.248283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea8c8bd-06c5-44e5-9b38-bf527be99636-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.248443 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:35:03.248370    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-serving-cert: secret "maas-api-e2e-ipp-b-02337c-serving-cert" not found
Jul 30 23:35:03.248443 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.248374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xs8\" (UniqueName: \"kubernetes.io/projected/eea8c8bd-06c5-44e5-9b38-bf527be99636-kube-api-access-z8xs8\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.248658 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:35:03.248450    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls podName:eea8c8bd-06c5-44e5-9b38-bf527be99636 nodeName:}" failed. No retries permitted until 2026-07-30 23:35:03.748427721 +0000 UTC m=+3300.809889104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls") pod "maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" (UID: "eea8c8bd-06c5-44e5-9b38-bf527be99636") : secret "maas-api-e2e-ipp-b-02337c-serving-cert" not found
Jul 30 23:35:03.249034 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.249014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea8c8bd-06c5-44e5-9b38-bf527be99636-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.259166 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.259138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xs8\" (UniqueName: \"kubernetes.io/projected/eea8c8bd-06c5-44e5-9b38-bf527be99636-kube-api-access-z8xs8\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.611767 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.611727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:35:03.712007 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.711974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:35:03.722019 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.721990    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:35:03.728721 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.728691    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:35:03.733642 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.733617    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:35:03.737432 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.737401    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:35:03.744689 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.744668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:35:03.749932 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.749912    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j4zlm_ba923054-f26a-4130-a790-c0f19e2cfcf3/ovn-acl-logging/0.log"
Jul 30 23:35:03.753450 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.753414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:03.753612 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:35:03.753561    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-serving-cert: secret "maas-api-e2e-ipp-b-02337c-serving-cert" not found
Jul 30 23:35:03.753696 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:35:03.753643    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls podName:eea8c8bd-06c5-44e5-9b38-bf527be99636 nodeName:}" failed. No retries permitted until 2026-07-30 23:35:04.75362296 +0000 UTC m=+3301.815084347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls") pod "maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" (UID: "eea8c8bd-06c5-44e5-9b38-bf527be99636") : secret "maas-api-e2e-ipp-b-02337c-serving-cert" not found
Jul 30 23:35:03.838858 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:03.838806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:35:04.763244 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:04.763198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:04.765872 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:04.765841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls\") pod \"maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:04.911822 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:04.911783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:05.054604 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:05.054553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"]
Jul 30 23:35:05.056441 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:35:05.056412    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea8c8bd_06c5_44e5_9b38_bf527be99636.slice/crio-668d4d80e389cf8cb0f486ac7f7c6acd49474abb4a69648498655c878a37e233 WatchSource:0}: Error finding container 668d4d80e389cf8cb0f486ac7f7c6acd49474abb4a69648498655c878a37e233: Status 404 returned error can't find the container with id 668d4d80e389cf8cb0f486ac7f7c6acd49474abb4a69648498655c878a37e233
Jul 30 23:35:05.057938 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:05.057920    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:35:06.014209 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:06.014174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" event={"ID":"eea8c8bd-06c5-44e5-9b38-bf527be99636","Type":"ContainerStarted","Data":"05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee"}
Jul 30 23:35:06.014642 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:06.014228    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" event={"ID":"eea8c8bd-06c5-44e5-9b38-bf527be99636","Type":"ContainerStarted","Data":"668d4d80e389cf8cb0f486ac7f7c6acd49474abb4a69648498655c878a37e233"}
Jul 30 23:35:06.014642 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:06.014378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:06.030974 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:06.030921    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" podStartSLOduration=2.585131421 podStartE2EDuration="3.030902496s" totalImagesPullingTime="445.771075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:35:06.030005948 +0000 UTC m=+3303.091467341" watchObservedRunningTime="2026-07-30 23:35:06.030902496 +0000 UTC m=+3303.092363891"
Jul 30 23:35:12.025587 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:12.025536    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:35:16.993201 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:16.993164    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:35:16.993651 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:16.993222    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 30 23:35:17.073798 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:17.073766    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerID="a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a" exitCode=0
Jul 30 23:35:17.073994 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:17.073837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" event={"ID":"ee97fa12-fb26-4319-91ba-ed98b8fe92a0","Type":"ContainerDied","Data":"a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a"}
Jul 30 23:35:17.074341 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:17.074320    2565 scope.go:117] "RemoveContainer" containerID="a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a"
Jul 30 23:35:17.075557 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:17.075533    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 23:35:17.075643 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:17.075630    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 23:35:17.075688 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:17.075668    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 30 23:35:18.091996 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:18.091949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" event={"ID":"ee97fa12-fb26-4319-91ba-ed98b8fe92a0","Type":"ContainerStarted","Data":"f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40"}
Jul 30 23:35:18.984390 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:18.984345    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:18.984824 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:18.984793    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:35:18.985019 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:18.984979    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 30 23:35:19.984214 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:19.984161    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:35:19.984759 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:19.984244    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 30 23:35:20.984399 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:20.984345    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:35:20.984945 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:20.984441    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 30 23:35:21.984386 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:21.984336    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:35:21.984646 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:21.984426    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 30 23:35:22.984060 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:22.984017    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:35:22.984371 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:22.984340    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 30 23:35:23.987609 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:23.987512    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:23.987969 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:23.987916    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:23.988519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:23.988500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:35:26.961487 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:26.961447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:35:37.818809 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:35:37.818773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:14.326693 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:14.326657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:16.259668 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:16.259630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:17.536244 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:17.536210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:17.637083 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:17.637048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:18.338590 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.338533    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"]
Jul 30 23:36:18.342419 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.342395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.345213 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.345191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-6a2f66-serving-cert\""
Jul 30 23:36:18.353098 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.353071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"]
Jul 30 23:36:18.373214 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.373151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:18.400399 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.400359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.400593 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.400412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4fcccdc-05cd-471a-a5b0-14663c148bdf-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.400593 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.400497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbd8\" (UniqueName: \"kubernetes.io/projected/a4fcccdc-05cd-471a-a5b0-14663c148bdf-kube-api-access-2pbd8\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.502178 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.502133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.502375 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.502194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4fcccdc-05cd-471a-a5b0-14663c148bdf-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.502375 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.502235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbd8\" (UniqueName: \"kubernetes.io/projected/a4fcccdc-05cd-471a-a5b0-14663c148bdf-kube-api-access-2pbd8\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.502375 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:36:18.502286    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-serving-cert: secret "maas-api-e2e-ipp-cleanup-6a2f66-serving-cert" not found
Jul 30 23:36:18.502375 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:36:18.502366    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls podName:a4fcccdc-05cd-471a-a5b0-14663c148bdf nodeName:}" failed. No retries permitted until 2026-07-30 23:36:19.002343086 +0000 UTC m=+3376.063804459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj" (UID: "a4fcccdc-05cd-471a-a5b0-14663c148bdf") : secret "maas-api-e2e-ipp-cleanup-6a2f66-serving-cert" not found
Jul 30 23:36:18.502982 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.502963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4fcccdc-05cd-471a-a5b0-14663c148bdf-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.511380 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.511357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbd8\" (UniqueName: \"kubernetes.io/projected/a4fcccdc-05cd-471a-a5b0-14663c148bdf-kube-api-access-2pbd8\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:18.849208 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.849176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:18.990705 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:18.990674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:19.008001 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:19.007964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:19.010690 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:19.010667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:19.254747 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:19.254709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:19.401209 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:19.401183    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"]
Jul 30 23:36:19.404063 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:36:19.404030    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fcccdc_05cd_471a_a5b0_14663c148bdf.slice/crio-fce090075cc470cda90777af43d39a7412e925497ce13157a5d83c702c8eb7a2 WatchSource:0}: Error finding container fce090075cc470cda90777af43d39a7412e925497ce13157a5d83c702c8eb7a2: Status 404 returned error can't find the container with id fce090075cc470cda90777af43d39a7412e925497ce13157a5d83c702c8eb7a2
Jul 30 23:36:20.409227 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:20.409192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj" event={"ID":"a4fcccdc-05cd-471a-a5b0-14663c148bdf","Type":"ContainerStarted","Data":"5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37"}
Jul 30 23:36:20.409645 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:20.409286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj" event={"ID":"a4fcccdc-05cd-471a-a5b0-14663c148bdf","Type":"ContainerStarted","Data":"fce090075cc470cda90777af43d39a7412e925497ce13157a5d83c702c8eb7a2"}
Jul 30 23:36:20.409645 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:20.409315    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:20.426703 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:20.426649    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj" podStartSLOduration=2.000724857 podStartE2EDuration="2.426632294s" totalImagesPullingTime="425.907437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:36:20.42479527 +0000 UTC m=+3377.486256667" watchObservedRunningTime="2026-07-30 23:36:20.426632294 +0000 UTC m=+3377.488093688"
Jul 30 23:36:26.419670 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:26.419635    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:42.121118 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:42.121083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:42.834048 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:42.834012    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"]
Jul 30 23:36:42.839108 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:42.839079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"
Jul 30 23:36:42.841637 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:42.841615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:36:42.845706 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:42.845676    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"]
Jul 30 23:36:42.939621 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:42.939556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/229c918e-9163-4f4c-9c2d-4f5ed96437db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5\" (UID: \"229c918e-9163-4f4c-9c2d-4f5ed96437db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"
Jul 30 23:36:43.040861 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:43.040823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/229c918e-9163-4f4c-9c2d-4f5ed96437db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5\" (UID: \"229c918e-9163-4f4c-9c2d-4f5ed96437db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"
Jul 30 23:36:43.041467 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:43.041446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/229c918e-9163-4f4c-9c2d-4f5ed96437db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5\" (UID: \"229c918e-9163-4f4c-9c2d-4f5ed96437db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"
Jul 30 23:36:43.150984 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:43.150943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"
Jul 30 23:36:43.303924 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:43.303897    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"]
Jul 30 23:36:43.306244 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:36:43.306212    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229c918e_9163_4f4c_9c2d_4f5ed96437db.slice/crio-bd8f165da5a506328c1a14a7184d258264b47a2d50f9c87fea10fa2a45d111ec WatchSource:0}: Error finding container bd8f165da5a506328c1a14a7184d258264b47a2d50f9c87fea10fa2a45d111ec: Status 404 returned error can't find the container with id bd8f165da5a506328c1a14a7184d258264b47a2d50f9c87fea10fa2a45d111ec
Jul 30 23:36:43.531008 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:43.530976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5" event={"ID":"229c918e-9163-4f4c-9c2d-4f5ed96437db","Type":"ContainerStarted","Data":"37d1be4ba010beaab8b0b89db2ad9f8cca301be18b0374349a438c09041020d8"}
Jul 30 23:36:43.531194 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:43.531032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5" event={"ID":"229c918e-9163-4f4c-9c2d-4f5ed96437db","Type":"ContainerStarted","Data":"bd8f165da5a506328c1a14a7184d258264b47a2d50f9c87fea10fa2a45d111ec"}
Jul 30 23:36:43.547417 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:43.547211    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5" podStartSLOduration=1.5471867289999999 podStartE2EDuration="1.547186729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:36:43.544599118 +0000 UTC m=+3400.606060510" watchObservedRunningTime="2026-07-30 23:36:43.547186729 +0000 UTC m=+3400.608648140"
Jul 30 23:36:44.537241 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:44.537201    2565 generic.go:356] "Generic (PLEG): container finished" podID="229c918e-9163-4f4c-9c2d-4f5ed96437db" containerID="37d1be4ba010beaab8b0b89db2ad9f8cca301be18b0374349a438c09041020d8" exitCode=0
Jul 30 23:36:44.537673 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:44.537243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5" event={"ID":"229c918e-9163-4f4c-9c2d-4f5ed96437db","Type":"ContainerDied","Data":"37d1be4ba010beaab8b0b89db2ad9f8cca301be18b0374349a438c09041020d8"}
Jul 30 23:36:45.680879 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:45.680851    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"
Jul 30 23:36:45.768235 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:45.768195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/229c918e-9163-4f4c-9c2d-4f5ed96437db-maas-api-service-ca\") pod \"229c918e-9163-4f4c-9c2d-4f5ed96437db\" (UID: \"229c918e-9163-4f4c-9c2d-4f5ed96437db\") "
Jul 30 23:36:45.768668 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:45.768643    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/229c918e-9163-4f4c-9c2d-4f5ed96437db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "229c918e-9163-4f4c-9c2d-4f5ed96437db" (UID: "229c918e-9163-4f4c-9c2d-4f5ed96437db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:36:45.869968 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:45.869877    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/229c918e-9163-4f4c-9c2d-4f5ed96437db-maas-api-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:36:46.549943 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:46.549908    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5" event={"ID":"229c918e-9163-4f4c-9c2d-4f5ed96437db","Type":"ContainerDied","Data":"bd8f165da5a506328c1a14a7184d258264b47a2d50f9c87fea10fa2a45d111ec"}
Jul 30 23:36:46.549943 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:46.549936    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"
Jul 30 23:36:46.550173 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:46.549966    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd8f165da5a506328c1a14a7184d258264b47a2d50f9c87fea10fa2a45d111ec"
Jul 30 23:36:48.680254 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.680219    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"]
Jul 30 23:36:48.680766 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.680489    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj" podUID="a4fcccdc-05cd-471a-a5b0-14663c148bdf" containerName="maas-api" containerID="cri-o://5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37" gracePeriod=30
Jul 30 23:36:48.719749 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.719721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:48.867243 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.867206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:48.941800 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.941733    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:48.954261 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.954227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:48.983874 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.983831    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"]
Jul 30 23:36:48.986327 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.986288    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6a2f66-w5bl5"]
Jul 30 23:36:48.998296 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.998259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pbd8\" (UniqueName: \"kubernetes.io/projected/a4fcccdc-05cd-471a-a5b0-14663c148bdf-kube-api-access-2pbd8\") pod \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") "
Jul 30 23:36:48.998488 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.998357    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls\") pod \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") "
Jul 30 23:36:48.998488 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.998425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4fcccdc-05cd-471a-a5b0-14663c148bdf-openshift-service-ca\") pod \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\" (UID: \"a4fcccdc-05cd-471a-a5b0-14663c148bdf\") "
Jul 30 23:36:48.998843 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.998814    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4fcccdc-05cd-471a-a5b0-14663c148bdf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a4fcccdc-05cd-471a-a5b0-14663c148bdf" (UID: "a4fcccdc-05cd-471a-a5b0-14663c148bdf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:36:48.999024 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:48.999000    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4fcccdc-05cd-471a-a5b0-14663c148bdf-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:36:49.001115 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.001086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4fcccdc-05cd-471a-a5b0-14663c148bdf-kube-api-access-2pbd8" (OuterVolumeSpecName: "kube-api-access-2pbd8") pod "a4fcccdc-05cd-471a-a5b0-14663c148bdf" (UID: "a4fcccdc-05cd-471a-a5b0-14663c148bdf"). InnerVolumeSpecName "kube-api-access-2pbd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:36:49.001224 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.001167    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a4fcccdc-05cd-471a-a5b0-14663c148bdf" (UID: "a4fcccdc-05cd-471a-a5b0-14663c148bdf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:36:49.018911 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.018857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:49.100435 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.100397    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4fcccdc-05cd-471a-a5b0-14663c148bdf-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:36:49.100435 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.100431    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pbd8\" (UniqueName: \"kubernetes.io/projected/a4fcccdc-05cd-471a-a5b0-14663c148bdf-kube-api-access-2pbd8\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:36:49.365398 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.365305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:49.470407 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.470365    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="229c918e-9163-4f4c-9c2d-4f5ed96437db" path="/var/lib/kubelet/pods/229c918e-9163-4f4c-9c2d-4f5ed96437db/volumes"
Jul 30 23:36:49.567727 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.567688    2565 generic.go:356] "Generic (PLEG): container finished" podID="a4fcccdc-05cd-471a-a5b0-14663c148bdf" containerID="5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37" exitCode=0
Jul 30 23:36:49.567881 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.567739    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"
Jul 30 23:36:49.567881 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.567773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj" event={"ID":"a4fcccdc-05cd-471a-a5b0-14663c148bdf","Type":"ContainerDied","Data":"5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37"}
Jul 30 23:36:49.567881 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.567831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj" event={"ID":"a4fcccdc-05cd-471a-a5b0-14663c148bdf","Type":"ContainerDied","Data":"fce090075cc470cda90777af43d39a7412e925497ce13157a5d83c702c8eb7a2"}
Jul 30 23:36:49.567881 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.567854    2565 scope.go:117] "RemoveContainer" containerID="5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37"
Jul 30 23:36:49.577406 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.577382    2565 scope.go:117] "RemoveContainer" containerID="5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37"
Jul 30 23:36:49.577789 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:36:49.577767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37\": container with ID starting with 5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37 not found: ID does not exist" containerID="5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37"
Jul 30 23:36:49.577875 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.577799    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37"} err="failed to get container status \"5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37\": rpc error: code = NotFound desc = could not find container \"5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37\": container with ID starting with 5ef260265566dbff370243fb0e069a941ae50582a82f1becdb1df6e7c5694e37 not found: ID does not exist"
Jul 30 23:36:49.589992 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.589953    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"]
Jul 30 23:36:49.592250 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:49.592220    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6a2f66-67f9f75ff7-v29bj"]
Jul 30 23:36:51.469510 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:51.469463    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4fcccdc-05cd-471a-a5b0-14663c148bdf" path="/var/lib/kubelet/pods/a4fcccdc-05cd-471a-a5b0-14663c148bdf/volumes"
Jul 30 23:36:55.236069 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:55.235933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:55.335828 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:55.335797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:55.515971 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:55.515855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:55.751395 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:36:55.751361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:14.641010 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:14.640964    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"]
Jul 30 23:37:14.641648 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:14.641271    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68" podUID="820f7f71-8a94-4b7d-8047-8a2d96fa29ce" containerName="maas-api" containerID="cri-o://5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7" gracePeriod=30
Jul 30 23:37:14.666635 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:14.666598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:14.735327 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:14.735295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:14.793638 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:14.793600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:14.920600 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:14.920556    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:37:14.987764 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:14.987725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:15.065356 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.065321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8dqb\" (UniqueName: \"kubernetes.io/projected/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-kube-api-access-f8dqb\") pod \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") "
Jul 30 23:37:15.065568 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.065375    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls\") pod \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") "
Jul 30 23:37:15.065568 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.065460    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-openshift-service-ca\") pod \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\" (UID: \"820f7f71-8a94-4b7d-8047-8a2d96fa29ce\") "
Jul 30 23:37:15.065893 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.065867    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "820f7f71-8a94-4b7d-8047-8a2d96fa29ce" (UID: "820f7f71-8a94-4b7d-8047-8a2d96fa29ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:37:15.067744 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.067716    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-kube-api-access-f8dqb" (OuterVolumeSpecName: "kube-api-access-f8dqb") pod "820f7f71-8a94-4b7d-8047-8a2d96fa29ce" (UID: "820f7f71-8a94-4b7d-8047-8a2d96fa29ce"). InnerVolumeSpecName "kube-api-access-f8dqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:37:15.067744 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.067713    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "820f7f71-8a94-4b7d-8047-8a2d96fa29ce" (UID: "820f7f71-8a94-4b7d-8047-8a2d96fa29ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:37:15.166572 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.166480    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8dqb\" (UniqueName: \"kubernetes.io/projected/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-kube-api-access-f8dqb\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:37:15.166572 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.166515    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:37:15.166572 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.166526    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820f7f71-8a94-4b7d-8047-8a2d96fa29ce-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:37:15.217169 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.217132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:15.702047 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.702007    2565 generic.go:356] "Generic (PLEG): container finished" podID="820f7f71-8a94-4b7d-8047-8a2d96fa29ce" containerID="5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7" exitCode=0
Jul 30 23:37:15.702047 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.702048    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"
Jul 30 23:37:15.702550 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.702082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68" event={"ID":"820f7f71-8a94-4b7d-8047-8a2d96fa29ce","Type":"ContainerDied","Data":"5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7"}
Jul 30 23:37:15.702550 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.702138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68" event={"ID":"820f7f71-8a94-4b7d-8047-8a2d96fa29ce","Type":"ContainerDied","Data":"399a54d4996cde38e161255579b48d44f1c6fbbd2a241116cae60b783a1f9d67"}
Jul 30 23:37:15.702550 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.702160    2565 scope.go:117] "RemoveContainer" containerID="5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7"
Jul 30 23:37:15.711795 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.711755    2565 scope.go:117] "RemoveContainer" containerID="5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7"
Jul 30 23:37:15.712174 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:37:15.712148    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7\": container with ID starting with 5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7 not found: ID does not exist" containerID="5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7"
Jul 30 23:37:15.712252 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.712186    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7"} err="failed to get container status \"5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7\": rpc error: code = NotFound desc = could not find container \"5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7\": container with ID starting with 5c3103499acc372549fa6ccb0f6a7e4435597e32474114bcdb2a4cf10dc1c2c7 not found: ID does not exist"
Jul 30 23:37:15.720876 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.720849    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"]
Jul 30 23:37:15.724609 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:15.724560    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-287423-665cb79df9-rws68"]
Jul 30 23:37:17.470323 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:17.470278    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820f7f71-8a94-4b7d-8047-8a2d96fa29ce" path="/var/lib/kubelet/pods/820f7f71-8a94-4b7d-8047-8a2d96fa29ce/volumes"
Jul 30 23:37:18.624908 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:18.624869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:20.254270 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:20.254224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:26.471488 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:26.471453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:26.572276 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:26.572237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:57.193858 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:57.193825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:57.417645 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:37:57.417602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:02.856037 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:02.856001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:17.047609 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:17.047551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:17.117040 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:17.116996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:17.362696 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:17.362568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:17.627410 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:17.627311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:28.106441 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.106352    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"]
Jul 30 23:38:28.107017 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.106609    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" podUID="eea8c8bd-06c5-44e5-9b38-bf527be99636" containerName="maas-api" containerID="cri-o://05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee" gracePeriod=30
Jul 30 23:38:28.134743 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.134717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:28.198376 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.198336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:28.278965 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.278924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:28.344159 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.344054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:28.369789 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.369712    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:38:28.509332 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.509288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea8c8bd-06c5-44e5-9b38-bf527be99636-openshift-service-ca\") pod \"eea8c8bd-06c5-44e5-9b38-bf527be99636\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") "
Jul 30 23:38:28.509536 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.509360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls\") pod \"eea8c8bd-06c5-44e5-9b38-bf527be99636\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") "
Jul 30 23:38:28.509536 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.509413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8xs8\" (UniqueName: \"kubernetes.io/projected/eea8c8bd-06c5-44e5-9b38-bf527be99636-kube-api-access-z8xs8\") pod \"eea8c8bd-06c5-44e5-9b38-bf527be99636\" (UID: \"eea8c8bd-06c5-44e5-9b38-bf527be99636\") "
Jul 30 23:38:28.509739 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.509711    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea8c8bd-06c5-44e5-9b38-bf527be99636-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eea8c8bd-06c5-44e5-9b38-bf527be99636" (UID: "eea8c8bd-06c5-44e5-9b38-bf527be99636"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:38:28.511643 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.511614    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea8c8bd-06c5-44e5-9b38-bf527be99636-kube-api-access-z8xs8" (OuterVolumeSpecName: "kube-api-access-z8xs8") pod "eea8c8bd-06c5-44e5-9b38-bf527be99636" (UID: "eea8c8bd-06c5-44e5-9b38-bf527be99636"). InnerVolumeSpecName "kube-api-access-z8xs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:28.511643 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.511624    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eea8c8bd-06c5-44e5-9b38-bf527be99636" (UID: "eea8c8bd-06c5-44e5-9b38-bf527be99636"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:38:28.610469 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.610430    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8xs8\" (UniqueName: \"kubernetes.io/projected/eea8c8bd-06c5-44e5-9b38-bf527be99636-kube-api-access-z8xs8\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:28.610469 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.610462    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea8c8bd-06c5-44e5-9b38-bf527be99636-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:28.610469 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.610473    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eea8c8bd-06c5-44e5-9b38-bf527be99636-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:28.703064 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:28.703027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:29.069202 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.069112    2565 generic.go:356] "Generic (PLEG): container finished" podID="eea8c8bd-06c5-44e5-9b38-bf527be99636" containerID="05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee" exitCode=0
Jul 30 23:38:29.069202 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.069159    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"
Jul 30 23:38:29.069202 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.069168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" event={"ID":"eea8c8bd-06c5-44e5-9b38-bf527be99636","Type":"ContainerDied","Data":"05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee"}
Jul 30 23:38:29.069436 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.069220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7" event={"ID":"eea8c8bd-06c5-44e5-9b38-bf527be99636","Type":"ContainerDied","Data":"668d4d80e389cf8cb0f486ac7f7c6acd49474abb4a69648498655c878a37e233"}
Jul 30 23:38:29.069436 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.069244    2565 scope.go:117] "RemoveContainer" containerID="05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee"
Jul 30 23:38:29.078468 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.078448    2565 scope.go:117] "RemoveContainer" containerID="05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee"
Jul 30 23:38:29.078834 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:38:29.078814    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee\": container with ID starting with 05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee not found: ID does not exist" containerID="05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee"
Jul 30 23:38:29.078911 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.078845    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee"} err="failed to get container status \"05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee\": rpc error: code = NotFound desc = could not find container \"05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee\": container with ID starting with 05351a150ced78fd4812f89d78c9246ab7017dd126097e40c830bb3a1c2fa9ee not found: ID does not exist"
Jul 30 23:38:29.090187 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.090159    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"]
Jul 30 23:38:29.095947 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.095921    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-02337c-ccc648964-9fgr7"]
Jul 30 23:38:29.470423 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:29.470388    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea8c8bd-06c5-44e5-9b38-bf527be99636" path="/var/lib/kubelet/pods/eea8c8bd-06c5-44e5-9b38-bf527be99636/volumes"
Jul 30 23:38:34.542407 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:34.542373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:34.603809 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:34.603761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:34.783933 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:34.783898    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"]
Jul 30 23:38:34.784144 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:34.784120    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" containerID="cri-o://f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40" gracePeriod=30
Jul 30 23:38:34.812111 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:34.812033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:35.040026 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:35.039992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:38.990601 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:38.990529    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 23:38:38.991009 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:38.990636    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:38:40.042144 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.042114    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:38:40.122504 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122415    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-credential-socket\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122504 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122464    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-podinfo\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122504 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-socket\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122513    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-certs\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122530    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-envoy\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istiod-ca-cert\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-token\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-data\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122752    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44ggs\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-kube-api-access-44ggs\") pod \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\" (UID: \"ee97fa12-fb26-4319-91ba-ed98b8fe92a0\") "
Jul 30 23:38:40.122815 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122747    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:40.123179 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122815    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:40.123179 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122844    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:40.123179 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.122981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:40.123179 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.123174    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-data\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.123611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.123190    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-credential-socket\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.123611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.123204    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-socket\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.123611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.123217    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-workload-certs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.123611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.123344    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:38:40.125512 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.125483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-kube-api-access-44ggs" (OuterVolumeSpecName: "kube-api-access-44ggs") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "kube-api-access-44ggs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:40.125648 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.125506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:40.125648 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.125535    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:40.125648 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.125548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee97fa12-fb26-4319-91ba-ed98b8fe92a0" (UID: "ee97fa12-fb26-4319-91ba-ed98b8fe92a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:38:40.125950 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.125927    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerID="f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40" exitCode=0
Jul 30 23:38:40.126033 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.125976    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"
Jul 30 23:38:40.126033 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.126010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" event={"ID":"ee97fa12-fb26-4319-91ba-ed98b8fe92a0","Type":"ContainerDied","Data":"f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40"}
Jul 30 23:38:40.126115 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.126071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp" event={"ID":"ee97fa12-fb26-4319-91ba-ed98b8fe92a0","Type":"ContainerDied","Data":"d03ba64401766c9f8bb952083891d3e584f289d1a136ae31fa1be901019ba3c0"}
Jul 30 23:38:40.126115 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.126102    2565 scope.go:117] "RemoveContainer" containerID="f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40"
Jul 30 23:38:40.145866 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.145847    2565 scope.go:117] "RemoveContainer" containerID="a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a"
Jul 30 23:38:40.154896 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.154799    2565 scope.go:117] "RemoveContainer" containerID="f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40"
Jul 30 23:38:40.155217 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:38:40.155185    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40\": container with ID starting with f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40 not found: ID does not exist" containerID="f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40"
Jul 30 23:38:40.155311 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.155229    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40"} err="failed to get container status \"f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40\": rpc error: code = NotFound desc = could not find container \"f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40\": container with ID starting with f2611bface3563e57ccaa69fea073d0f906d6634f2450c876d9b27f216863c40 not found: ID does not exist"
Jul 30 23:38:40.155311 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.155253    2565 scope.go:117] "RemoveContainer" containerID="a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a"
Jul 30 23:38:40.155551 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:38:40.155526    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a\": container with ID starting with a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a not found: ID does not exist" containerID="a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a"
Jul 30 23:38:40.155684 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.155558    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a"} err="failed to get container status \"a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a\": rpc error: code = NotFound desc = could not find container \"a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a\": container with ID starting with a3974172081bc1588b9625246da6aab4b2d2d77b484d551faa833a403b6c5e8a not found: ID does not exist"
Jul 30 23:38:40.157604 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.157564    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"]
Jul 30 23:38:40.160703 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.160678    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-02337c-openshift-default-766dd99556-24khp"]
Jul 30 23:38:40.223898 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.223855    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44ggs\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-kube-api-access-44ggs\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.223898 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.223889    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-podinfo\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.223898 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.223902    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-envoy\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.223898 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.223911    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istiod-ca-cert\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:40.224165 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:40.223919    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97fa12-fb26-4319-91ba-ed98b8fe92a0-istio-token\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:41.470043 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:41.470010    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" path="/var/lib/kubelet/pods/ee97fa12-fb26-4319-91ba-ed98b8fe92a0/volumes"
Jul 30 23:38:45.739750 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:45.739714    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"]
Jul 30 23:38:45.740173 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:45.739922    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q" podUID="90dbeb39-3ad1-4866-9ffc-46b6898d3953" containerName="maas-api" containerID="cri-o://8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55" gracePeriod=30
Jul 30 23:38:45.774363 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:45.774332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:45.874953 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:45.874923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:45.939269 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:45.939224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:45.994961 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:45.994891    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:38:46.084522 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.084484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgm6v\" (UniqueName: \"kubernetes.io/projected/90dbeb39-3ad1-4866-9ffc-46b6898d3953-kube-api-access-jgm6v\") pod \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") "
Jul 30 23:38:46.084766 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.084660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90dbeb39-3ad1-4866-9ffc-46b6898d3953-maas-api-tls\") pod \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") "
Jul 30 23:38:46.084766 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.084678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90dbeb39-3ad1-4866-9ffc-46b6898d3953-openshift-service-ca\") pod \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\" (UID: \"90dbeb39-3ad1-4866-9ffc-46b6898d3953\") "
Jul 30 23:38:46.085106 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.085083    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90dbeb39-3ad1-4866-9ffc-46b6898d3953-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90dbeb39-3ad1-4866-9ffc-46b6898d3953" (UID: "90dbeb39-3ad1-4866-9ffc-46b6898d3953"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:38:46.086758 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.086732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90dbeb39-3ad1-4866-9ffc-46b6898d3953-kube-api-access-jgm6v" (OuterVolumeSpecName: "kube-api-access-jgm6v") pod "90dbeb39-3ad1-4866-9ffc-46b6898d3953" (UID: "90dbeb39-3ad1-4866-9ffc-46b6898d3953"). InnerVolumeSpecName "kube-api-access-jgm6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:46.086892 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.086874    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90dbeb39-3ad1-4866-9ffc-46b6898d3953-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90dbeb39-3ad1-4866-9ffc-46b6898d3953" (UID: "90dbeb39-3ad1-4866-9ffc-46b6898d3953"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:38:46.157048 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.157012    2565 generic.go:356] "Generic (PLEG): container finished" podID="90dbeb39-3ad1-4866-9ffc-46b6898d3953" containerID="8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55" exitCode=0
Jul 30 23:38:46.157264 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.157061    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"
Jul 30 23:38:46.157264 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.157096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q" event={"ID":"90dbeb39-3ad1-4866-9ffc-46b6898d3953","Type":"ContainerDied","Data":"8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55"}
Jul 30 23:38:46.157264 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.157151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q" event={"ID":"90dbeb39-3ad1-4866-9ffc-46b6898d3953","Type":"ContainerDied","Data":"5042281c895016484d3ecf2600408e0ffd34bb875aeb68aefda680f7d67f0008"}
Jul 30 23:38:46.157264 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.157173    2565 scope.go:117] "RemoveContainer" containerID="8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55"
Jul 30 23:38:46.167155 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.167138    2565 scope.go:117] "RemoveContainer" containerID="8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55"
Jul 30 23:38:46.167444 ip-10-0-137-134 kubenswrapper[2565]: E0730 23:38:46.167423    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55\": container with ID starting with 8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55 not found: ID does not exist" containerID="8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55"
Jul 30 23:38:46.167506 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.167456    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55"} err="failed to get container status \"8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55\": rpc error: code = NotFound desc = could not find container \"8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55\": container with ID starting with 8fa97b656552e288e5ee3c593af70f27b0053c82b6e82d79b6a6f0903e2f8b55 not found: ID does not exist"
Jul 30 23:38:46.179003 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.178977    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"]
Jul 30 23:38:46.180772 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.180751    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-80952f-644847bfc5-zc54q"]
Jul 30 23:38:46.185345 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.185327    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgm6v\" (UniqueName: \"kubernetes.io/projected/90dbeb39-3ad1-4866-9ffc-46b6898d3953-kube-api-access-jgm6v\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:46.185403 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.185348    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90dbeb39-3ad1-4866-9ffc-46b6898d3953-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:46.185403 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.185358    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90dbeb39-3ad1-4866-9ffc-46b6898d3953-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:38:46.326147 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:46.326056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:47.471132 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:47.471090    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90dbeb39-3ad1-4866-9ffc-46b6898d3953" path="/var/lib/kubelet/pods/90dbeb39-3ad1-4866-9ffc-46b6898d3953/volumes"
Jul 30 23:38:52.573437 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:52.573401    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:52.677011 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:52.676965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:52.846927 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:52.846839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:53.084792 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:38:53.084753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:03.591107 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.591066    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"]
Jul 30 23:39:03.591727 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.591347    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8" podUID="9c216a02-fb82-483b-adef-6fe3523cceb0" containerName="maas-api" containerID="cri-o://fbd4c2f069a5def85837ec1f8d42de1b56d13d5877b83d3d60f9b76c61d972a8" gracePeriod=30
Jul 30 23:39:03.621608 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.621565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:03.685889 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.685848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:03.785329 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.785232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:03.839276 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.839244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:03.848592 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.848507    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:39:03.883790 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.883756    2565 scope.go:117] "RemoveContainer" containerID="fbd4c2f069a5def85837ec1f8d42de1b56d13d5877b83d3d60f9b76c61d972a8"
Jul 30 23:39:03.963747 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.963713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls\") pod \"9c216a02-fb82-483b-adef-6fe3523cceb0\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") "
Jul 30 23:39:03.963945 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.963821    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdkmm\" (UniqueName: \"kubernetes.io/projected/9c216a02-fb82-483b-adef-6fe3523cceb0-kube-api-access-mdkmm\") pod \"9c216a02-fb82-483b-adef-6fe3523cceb0\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") "
Jul 30 23:39:03.963945 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.963853    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c216a02-fb82-483b-adef-6fe3523cceb0-openshift-service-ca\") pod \"9c216a02-fb82-483b-adef-6fe3523cceb0\" (UID: \"9c216a02-fb82-483b-adef-6fe3523cceb0\") "
Jul 30 23:39:03.964328 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.964298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c216a02-fb82-483b-adef-6fe3523cceb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c216a02-fb82-483b-adef-6fe3523cceb0" (UID: "9c216a02-fb82-483b-adef-6fe3523cceb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:39:03.966256 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.966226    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c216a02-fb82-483b-adef-6fe3523cceb0-kube-api-access-mdkmm" (OuterVolumeSpecName: "kube-api-access-mdkmm") pod "9c216a02-fb82-483b-adef-6fe3523cceb0" (UID: "9c216a02-fb82-483b-adef-6fe3523cceb0"). InnerVolumeSpecName "kube-api-access-mdkmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:39:03.966436 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:03.966413    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c216a02-fb82-483b-adef-6fe3523cceb0" (UID: "9c216a02-fb82-483b-adef-6fe3523cceb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:39:04.064946 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.064903    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdkmm\" (UniqueName: \"kubernetes.io/projected/9c216a02-fb82-483b-adef-6fe3523cceb0-kube-api-access-mdkmm\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:39:04.064946 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.064941    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c216a02-fb82-483b-adef-6fe3523cceb0-openshift-service-ca\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:39:04.064946 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.064951    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c216a02-fb82-483b-adef-6fe3523cceb0-maas-api-tls\") on node \"ip-10-0-137-134.ec2.internal\" DevicePath \"\""
Jul 30 23:39:04.160627 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.160547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:04.251741 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.251707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"
Jul 30 23:39:04.251741 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.251721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8" event={"ID":"9c216a02-fb82-483b-adef-6fe3523cceb0","Type":"ContainerDied","Data":"fbd4c2f069a5def85837ec1f8d42de1b56d13d5877b83d3d60f9b76c61d972a8"}
Jul 30 23:39:04.251981 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.251781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8" event={"ID":"9c216a02-fb82-483b-adef-6fe3523cceb0","Type":"ContainerDied","Data":"dfee0182453959859d434bc27d7b0c5206a49d036b88ee3bb713847b7c7c8a87"}
Jul 30 23:39:04.279428 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.279389    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"]
Jul 30 23:39:04.283245 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:04.283216    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bb1098-649fd67454-v99f8"]
Jul 30 23:39:05.469313 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:05.469274    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c216a02-fb82-483b-adef-6fe3523cceb0" path="/var/lib/kubelet/pods/9c216a02-fb82-483b-adef-6fe3523cceb0/volumes"
Jul 30 23:39:06.231003 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:06.230967    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:10.154255 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:10.154216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:10.256765 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:10.256729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:10.441619 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:10.441504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:10.666751 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:10.666700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:17.104027 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:17.103990    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f7477f447-ctkmb_eae8a323-75ae-4ca9-ae8c-caab2e454816/manager/0.log"
Jul 30 23:39:17.732478 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:17.732447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-v9w86_de9cdb52-cb8e-4e34-ae4f-73207868e06f/copy-manifests/0.log"
Jul 30 23:39:17.739966 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:17.739942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-v9w86_de9cdb52-cb8e-4e34-ae4f-73207868e06f/manager/0.log"
Jul 30 23:39:18.119360 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:18.119281    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5b76fdb84c-frqkx_0146856b-8dc4-4fc1-8588-8cc6202988a1/maas-api/0.log"
Jul 30 23:39:18.470956 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:18.470918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757570-6z672_acfba43c-9635-45a3-8d8e-6d41795c135a/cleanup/0.log"
Jul 30 23:39:20.510073 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:20.510043    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t_db910a28-28dd-4b79-a8ce-f3488116ef4a/istio-proxy/0.log"
Jul 30 23:39:20.625245 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:20.625215    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v2fqr_0212f185-d409-4b4c-a0e4-8c69fb58baf8/discovery/0.log"
Jul 30 23:39:20.986481 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:20.986434    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4p5gj_422acd91-ea21-4b8d-8f7e-c30b80403284/istio-proxy/1.log"
Jul 30 23:39:21.112344 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:21.112309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p2rpw_474e30c9-d811-4204-b8e0-fecd2b719752/payload-pre-processing/0.log"
Jul 30 23:39:21.356170 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:21.356080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfdd7b448-4nxrm_0b021827-5c88-4bb7-8d39-56b0b3f3cb00/router/0.log"
Jul 30 23:39:21.727446 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:21.727417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rjbf8_98a40368-c63b-4534-b7f0-070624146d19/main/0.log"
Jul 30 23:39:22.096930 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:22.096851    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdgl44_1f901f06-3239-47c8-87c1-bb22c4f91dcf/main/0.log"
Jul 30 23:39:22.219741 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:22.219711    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-k8gdj_f7cc376c-445d-4618-bed9-9374b202aa54/main/0.log"
Jul 30 23:39:24.980453 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:24.980420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:25.033021 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:25.032988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:28.123481 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:28.123448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:28.200823 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:28.200784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:30.999379 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:30.999351    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-69zk4_8919e466-cff0-4c4f-b85d-b98ca5f4bbe1/global-pull-secret-syncer/0.log"
Jul 30 23:39:31.133462 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:31.133432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log"
Jul 30 23:39:31.238991 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:31.238958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-134.ec2.internal_518fa4cb778829bfdb295bed0f31592e/haproxy/0.log"
Jul 30 23:39:31.711381 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:31.711349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vtq5_6e63f9ed-05f2-4b20-8952-71b930abe223/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:38.095399 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.095367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/1.log"
Jul 30 23:39:38.180796 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.180765    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-vvkps_ff4d9cd9-80d1-42ea-85d2-6dd1afd7f1ef/cluster-monitoring-operator/0.log"
Jul 30 23:39:38.463189 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.463161    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7pp9s_a81e0576-d7e4-4ed0-9708-170d932e9d61/node-exporter/0.log"
Jul 30 23:39:38.485294 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.485260    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7pp9s_a81e0576-d7e4-4ed0-9708-170d932e9d61/kube-rbac-proxy/0.log"
Jul 30 23:39:38.508048 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.508022    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7pp9s_a81e0576-d7e4-4ed0-9708-170d932e9d61/init-textfile/0.log"
Jul 30 23:39:38.733901 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.733821    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8722f322-cf43-40c6-9fc2-1c364f14b7fd/prometheus/0.log"
Jul 30 23:39:38.760942 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.760916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8722f322-cf43-40c6-9fc2-1c364f14b7fd/config-reloader/0.log"
Jul 30 23:39:38.785280 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.785257    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8722f322-cf43-40c6-9fc2-1c364f14b7fd/thanos-sidecar/0.log"
Jul 30 23:39:38.807033 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.807008    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8722f322-cf43-40c6-9fc2-1c364f14b7fd/kube-rbac-proxy-web/0.log"
Jul 30 23:39:38.829996 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.829971    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8722f322-cf43-40c6-9fc2-1c364f14b7fd/kube-rbac-proxy/0.log"
Jul 30 23:39:38.852335 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.852310    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8722f322-cf43-40c6-9fc2-1c364f14b7fd/kube-rbac-proxy-thanos/0.log"
Jul 30 23:39:38.874227 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:38.874201    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8722f322-cf43-40c6-9fc2-1c364f14b7fd/init-config-reloader/0.log"
Jul 30 23:39:40.426733 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:40.426704    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-8lwtm_6b9fcb69-990d-4384-8efb-787b257a2e02/networking-console-plugin/0.log"
Jul 30 23:39:41.025372 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.025325    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/2.log"
Jul 30 23:39:41.029395 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.029372    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-lm6hk_b716fefc-6f1c-4dfc-a5cd-e74ae8582fde/console-operator/3.log"
Jul 30 23:39:41.414872 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.414831    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"]
Jul 30 23:39:41.415290 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415273    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90dbeb39-3ad1-4866-9ffc-46b6898d3953" containerName="maas-api"
Jul 30 23:39:41.415338 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415292    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90dbeb39-3ad1-4866-9ffc-46b6898d3953" containerName="maas-api"
Jul 30 23:39:41.415338 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415304    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy"
Jul 30 23:39:41.415338 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415309    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy"
Jul 30 23:39:41.415338 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415323    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c216a02-fb82-483b-adef-6fe3523cceb0" containerName="maas-api"
Jul 30 23:39:41.415338 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415329    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c216a02-fb82-483b-adef-6fe3523cceb0" containerName="maas-api"
Jul 30 23:39:41.415338 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415337    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415342    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415350    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820f7f71-8a94-4b7d-8047-8a2d96fa29ce" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415356    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="820f7f71-8a94-4b7d-8047-8a2d96fa29ce" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415363    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea8c8bd-06c5-44e5-9b38-bf527be99636" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415368    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea8c8bd-06c5-44e5-9b38-bf527be99636" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415377    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4fcccdc-05cd-471a-a5b0-14663c148bdf" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415381    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4fcccdc-05cd-471a-a5b0-14663c148bdf" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415391    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="229c918e-9163-4f4c-9c2d-4f5ed96437db" containerName="revoke-keys"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415396    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="229c918e-9163-4f4c-9c2d-4f5ed96437db" containerName="revoke-keys"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415464    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90dbeb39-3ad1-4866-9ffc-46b6898d3953" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415473    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="229c918e-9163-4f4c-9c2d-4f5ed96437db" containerName="revoke-keys"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415478    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4fcccdc-05cd-471a-a5b0-14663c148bdf" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415486    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="820f7f71-8a94-4b7d-8047-8a2d96fa29ce" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415492    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c216a02-fb82-483b-adef-6fe3523cceb0" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415500    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415505    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea8c8bd-06c5-44e5-9b38-bf527be99636" containerName="maas-api"
Jul 30 23:39:41.415519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.415511    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee97fa12-fb26-4319-91ba-ed98b8fe92a0" containerName="istio-proxy"
Jul 30 23:39:41.418922 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.418904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.421248 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.421227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nv5zt\"/\"default-dockercfg-7rfhb\""
Jul 30 23:39:41.421375 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.421301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nv5zt\"/\"openshift-service-ca.crt\""
Jul 30 23:39:41.422132 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.422117    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nv5zt\"/\"kube-root-ca.crt\""
Jul 30 23:39:41.429869 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.429844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"]
Jul 30 23:39:41.517383 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.517341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-podres\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.517611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.517402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js2m2\" (UniqueName: \"kubernetes.io/projected/33a7517a-801f-460b-835e-3ded0c4265fe-kube-api-access-js2m2\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.517611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.517451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-sys\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.517611 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.517550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-proc\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.517745 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.517663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-lib-modules\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619030 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.618992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-proc\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619222 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-lib-modules\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619222 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-podres\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619222 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js2m2\" (UniqueName: \"kubernetes.io/projected/33a7517a-801f-460b-835e-3ded0c4265fe-kube-api-access-js2m2\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619222 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-proc\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619222 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-sys\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619496 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-sys\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619496 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-podres\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.619496 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.619283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33a7517a-801f-460b-835e-3ded0c4265fe-lib-modules\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.627034 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.627007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js2m2\" (UniqueName: \"kubernetes.io/projected/33a7517a-801f-460b-835e-3ded0c4265fe-kube-api-access-js2m2\") pod \"perf-node-gather-daemonset-99xsv\" (UID: \"33a7517a-801f-460b-835e-3ded0c4265fe\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.730879 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.730768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:41.867072 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:41.866968    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"]
Jul 30 23:39:41.869625 ip-10-0-137-134 kubenswrapper[2565]: W0730 23:39:41.869571    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33a7517a_801f_460b_835e_3ded0c4265fe.slice/crio-f9769aae981fc88d67f5c298cb7e0f931357cf235b53c06acd47f9b6da275c08 WatchSource:0}: Error finding container f9769aae981fc88d67f5c298cb7e0f931357cf235b53c06acd47f9b6da275c08: Status 404 returned error can't find the container with id f9769aae981fc88d67f5c298cb7e0f931357cf235b53c06acd47f9b6da275c08
Jul 30 23:39:42.329509 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:42.329432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-nhzzm_92ac6874-d309-4917-849d-9d5ce7f45d2e/volume-data-source-validator/0.log"
Jul 30 23:39:42.438883 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:42.438839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv" event={"ID":"33a7517a-801f-460b-835e-3ded0c4265fe","Type":"ContainerStarted","Data":"84ecd37107103969848c1c49e765b3ebf4852c947835864eca47b9f910f33ebc"}
Jul 30 23:39:42.439312 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:42.438897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv" event={"ID":"33a7517a-801f-460b-835e-3ded0c4265fe","Type":"ContainerStarted","Data":"f9769aae981fc88d67f5c298cb7e0f931357cf235b53c06acd47f9b6da275c08"}
Jul 30 23:39:42.439312 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:42.438971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:42.455873 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:42.455829    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv" podStartSLOduration=1.455814159 podStartE2EDuration="1.455814159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 23:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:39:42.453497569 +0000 UTC m=+3579.514958964" watchObservedRunningTime="2026-07-30 23:39:42.455814159 +0000 UTC m=+3579.517275602"
Jul 30 23:39:43.392205 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:43.392176    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5v87q_4d8c414b-ec44-4ea6-832c-8f378ce019de/dns/0.log"
Jul 30 23:39:43.412491 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:43.412460    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5v87q_4d8c414b-ec44-4ea6-832c-8f378ce019de/kube-rbac-proxy/0.log"
Jul 30 23:39:43.555477 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:43.555438    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5c5m_51b906bc-8445-4b46-9236-9d66b897c705/dns-node-resolver/0.log"
Jul 30 23:39:44.152797 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:44.152766    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mwcds_8379cc47-c521-4660-9c0d-a40f4e63ea13/node-ca/0.log"
Jul 30 23:39:45.082619 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:45.082571    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t_db910a28-28dd-4b79-a8ce-f3488116ef4a/istio-proxy/0.log"
Jul 30 23:39:45.246434 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:45.246400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v2fqr_0212f185-d409-4b4c-a0e4-8c69fb58baf8/discovery/0.log"
Jul 30 23:39:45.331370 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:45.331342    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4p5gj_422acd91-ea21-4b8d-8f7e-c30b80403284/istio-proxy/0.log"
Jul 30 23:39:45.337621 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:45.337518    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4p5gj_422acd91-ea21-4b8d-8f7e-c30b80403284/istio-proxy/1.log"
Jul 30 23:39:45.372475 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:45.372440    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p2rpw_474e30c9-d811-4204-b8e0-fecd2b719752/payload-pre-processing/0.log"
Jul 30 23:39:45.427052 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:45.427013    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfdd7b448-4nxrm_0b021827-5c88-4bb7-8d39-56b0b3f3cb00/router/0.log"
Jul 30 23:39:46.234731 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:46.234694    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nxx6m_f0287a25-f1f5-43f4-8585-7c0d0f3545b1/serve-healthcheck-canary/0.log"
Jul 30 23:39:46.705799 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:46.705758    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-8wrtv_5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51/insights-operator/0.log"
Jul 30 23:39:46.706692 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:46.706659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-8wrtv_5aeb9916-e2c2-4c9b-bc7c-80a9a490fa51/insights-operator/1.log"
Jul 30 23:39:46.802338 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:46.802303    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jn6rl_f6a4ab7c-97a9-4182-9800-b55e2b98cdfd/kube-rbac-proxy/0.log"
Jul 30 23:39:46.822791 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:46.822755    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jn6rl_f6a4ab7c-97a9-4182-9800-b55e2b98cdfd/exporter/0.log"
Jul 30 23:39:46.843562 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:46.843535    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jn6rl_f6a4ab7c-97a9-4182-9800-b55e2b98cdfd/extractor/0.log"
Jul 30 23:39:48.457519 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:48.457491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-99xsv"
Jul 30 23:39:49.305018 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:49.304983    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f7477f447-ctkmb_eae8a323-75ae-4ca9-ae8c-caab2e454816/manager/0.log"
Jul 30 23:39:49.653726 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:49.653696    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-v9w86_de9cdb52-cb8e-4e34-ae4f-73207868e06f/manager/0.log"
Jul 30 23:39:49.673825 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:49.673797    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-v9w86_de9cdb52-cb8e-4e34-ae4f-73207868e06f/copy-manifests/0.log"
Jul 30 23:39:51.051635 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:51.051601    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c6cc5589b-89wkt_95738e84-2f5e-441d-910e-fdcd21b155a1/manager/0.log"
Jul 30 23:39:51.829051 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:51.829023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t_db910a28-28dd-4b79-a8ce-f3488116ef4a/istio-proxy/0.log"
Jul 30 23:39:51.992346 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:51.992308    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v2fqr_0212f185-d409-4b4c-a0e4-8c69fb58baf8/discovery/0.log"
Jul 30 23:39:52.037954 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:52.037869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4p5gj_422acd91-ea21-4b8d-8f7e-c30b80403284/istio-proxy/0.log"
Jul 30 23:39:52.044822 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:52.044798    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4p5gj_422acd91-ea21-4b8d-8f7e-c30b80403284/istio-proxy/1.log"
Jul 30 23:39:52.062548 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:52.062522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p2rpw_474e30c9-d811-4204-b8e0-fecd2b719752/payload-pre-processing/0.log"
Jul 30 23:39:52.094626 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:52.094596    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfdd7b448-4nxrm_0b021827-5c88-4bb7-8d39-56b0b3f3cb00/router/0.log"
Jul 30 23:39:53.545888 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:53.545810    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7ch2t_db910a28-28dd-4b79-a8ce-f3488116ef4a/istio-proxy/0.log"
Jul 30 23:39:53.714839 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:53.714806    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v2fqr_0212f185-d409-4b4c-a0e4-8c69fb58baf8/discovery/0.log"
Jul 30 23:39:53.761813 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:53.761777    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4p5gj_422acd91-ea21-4b8d-8f7e-c30b80403284/istio-proxy/0.log"
Jul 30 23:39:53.768458 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:53.768428    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4p5gj_422acd91-ea21-4b8d-8f7e-c30b80403284/istio-proxy/1.log"
Jul 30 23:39:53.787743 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:53.787718    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p2rpw_474e30c9-d811-4204-b8e0-fecd2b719752/payload-pre-processing/0.log"
Jul 30 23:39:53.822453 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:53.822371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfdd7b448-4nxrm_0b021827-5c88-4bb7-8d39-56b0b3f3cb00/router/0.log"
Jul 30 23:39:56.239548 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:56.239518    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-sz9px_9e33ab36-72cf-4d79-81fb-88cfd61ed69d/migrator/0.log"
Jul 30 23:39:56.259369 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:56.259324    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-sz9px_9e33ab36-72cf-4d79-81fb-88cfd61ed69d/graceful-termination/0.log"
Jul 30 23:39:56.595075 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:56.594970    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-nl7fv_f5ffafa8-d18e-49ef-8438-fb6b87c81825/kube-storage-version-migrator-operator/1.log"
Jul 30 23:39:56.595879 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:56.595842    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-nl7fv_f5ffafa8-d18e-49ef-8438-fb6b87c81825/kube-storage-version-migrator-operator/0.log"
Jul 30 23:39:57.589962 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:57.589934    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg4kh_f046a693-f7fb-4768-9f0b-2ab613660a9f/kube-multus-additional-cni-plugins/0.log"
Jul 30 23:39:57.611201 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:57.611175    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg4kh_f046a693-f7fb-4768-9f0b-2ab613660a9f/egress-router-binary-copy/0.log"
Jul 30 23:39:57.633172 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:57.633141    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg4kh_f046a693-f7fb-4768-9f0b-2ab613660a9f/cni-plugins/0.log"
Jul 30 23:39:57.654255 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:57.654228    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg4kh_f046a693-f7fb-4768-9f0b-2ab613660a9f/bond-cni-plugin/0.log"
Jul 30 23:39:57.674088 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:57.674056    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg4kh_f046a693-f7fb-4768-9f0b-2ab613660a9f/routeoverride-cni/0.log"
Jul 30 23:39:57.694452 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:57.694350    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg4kh_f046a693-f7fb-4768-9f0b-2ab613660a9f/whereabouts-cni-bincopy/0.log"
Jul 30 23:39:57.713610 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:57.713562    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg4kh_f046a693-f7fb-4768-9f0b-2ab613660a9f/whereabouts-cni/0.log"
Jul 30 23:39:58.141180 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:58.141149    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jznvw_4096f4c0-18c1-414f-ba76-8a3e0620276f/kube-multus/0.log"
Jul 30 23:39:58.259662 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:58.259630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rfbsc_32b3fce6-25a2-40da-a249-56a8a68ec276/network-metrics-daemon/0.log"
Jul 30 23:39:58.281621 ip-10-0-137-134 kubenswrapper[2565]: I0730 23:39:58.281567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rfbsc_32b3fce6-25a2-40da-a249-56a8a68ec276/kube-rbac-proxy/0.log"