Jul 11 03:46:42.181006 ip-10-0-138-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 11 03:46:42.181018 ip-10-0-138-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 11 03:46:42.181026 ip-10-0-138-121 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 11 03:46:42.181277 ip-10-0-138-121 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 11 03:46:51.819058 ip-10-0-138-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 11 03:46:51.819067 ip-10-0-138-121 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f400ef3ccb91472a90b4b7c470d12841 --
Jul 11 03:48:19.507852 ip-10-0-138-121 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 03:48:19.970985 ip-10-0-138-121 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:19.970985 ip-10-0-138-121 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 03:48:19.970985 ip-10-0-138-121 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:19.970985 ip-10-0-138-121 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 03:48:19.970985 ip-10-0-138-121 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:19.973650 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.973557    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 03:48:19.977676 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977658    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:19.977676 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977675    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977679    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977683    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977686    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977689    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977692    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977695    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977698    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977701    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977704    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977707    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977710    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977712    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977716    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977719    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977721    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977724    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977727    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977729    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977732    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:19.977739 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977734    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977737    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977740    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977743    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977747    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977751    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977754    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977757    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977760    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977762    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977765    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977767    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977770    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977773    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977775    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977778    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977780    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977783    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977785    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:19.978236 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977788    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977791    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977793    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977796    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977798    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977801    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977804    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977806    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977809    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977811    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977814    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977817    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977819    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977821    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977824    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977827    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977830    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977833    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977835    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977838    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:19.978699 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977840    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977843    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977846    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977849    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977852    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977855    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977858    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977860    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977863    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977867    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977870    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977874    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977876    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977879    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977882    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977885    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977888    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977891    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977894    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977898    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:19.979180 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977901    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977903    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977907    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977909    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977912    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977914    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977917    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977921    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977924    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977926    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977929    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977932    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977935    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977937    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977940    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977942    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977945    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977948    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.977952    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:19.979659 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978681    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978688    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978692    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978696    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978699    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978702    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978705    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978708    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978710    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978713    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978716    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978719    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978723    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978726    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978729    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978731    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978734    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978737    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978739    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978743    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:19.980116 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978746    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978749    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978751    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978754    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978756    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978759    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978762    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978765    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978767    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978770    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978773    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978775    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978778    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978781    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978783    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978786    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978789    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978792    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978794    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:19.980656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978796    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978799    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978802    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978805    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978807    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978810    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978813    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978815    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978818    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978822    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978824    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978827    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978830    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978833    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978835    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978838    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978840    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978843    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978846    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978848    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:19.981108 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978851    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978853    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978856    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978858    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978861    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978863    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978866    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978868    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978873    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978877    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978881    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978884    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978887    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978890    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978893    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978895    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978898    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978901    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978905    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:19.981621 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978907    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978911    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978914    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978916    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978919    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978922    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978924    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978927    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978929    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978932    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978934    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978937    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978939    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978942    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978944    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978947    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978950    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978952    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978954    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978957    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:19.982074 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.978960    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979337    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979342    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979344    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979347    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979350    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979352    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979355    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979358    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979360    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979363    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979366    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979369    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979371    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979374    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979377    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979380    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979383    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979385    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979388    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:19.982556 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979390    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979393    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979396    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979398    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979401    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979404    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979408    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979411    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979414    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979417    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979420    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979423    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979425    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979428    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979431    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979433    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979436    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979439    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979441    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:19.983038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979444    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979446    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979449    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979451    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979454    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979457    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979459    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979464    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979467    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979470    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979472    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979475    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979477    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979480    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979482    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979485    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979488    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979505    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979508    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979512    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:19.983489 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979517    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979521    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979524    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979528    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979531    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979534    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979537    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979540    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979543    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979546    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979549    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979552    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979554    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979557    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979560    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979563    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979565    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979568    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979571    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:19.984069 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979577    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979579    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979582    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979586    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979588    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979591    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979594    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979596    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979599    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979602    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979604    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979607    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979609    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979612    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979615    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979617    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979620    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979623    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979627    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979630    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:19.984552 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979633    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.979635    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979712    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979720    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979730    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979737    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979743    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979748    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979753    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979757    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979760    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979763    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979770    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979773    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979776    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979779    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979782    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979785    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979788    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979791    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979795    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979798    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979801    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979805    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 03:48:19.985027 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979808    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979812    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979815    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979818    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979821    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979824    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979829    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979832    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979835    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979838    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979842    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979845    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979848    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979851    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979854    2558 flags.go:64] FLAG: --enable-server="true"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979857    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979862    2558 flags.go:64] FLAG: --event-burst="100"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979865    2558 flags.go:64] FLAG: --event-qps="50"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979868    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979871    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979876    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979880    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979883    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979886    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979889    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 11 03:48:19.985659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979892    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979895    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979898    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979901    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979904    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979908    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979911    2558 flags.go:64] FLAG: --feature-gates=""
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979915    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979918    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979921    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979925    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979928    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979931    2558 flags.go:64] FLAG: --help="false"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979935    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-121.ec2.internal"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979938    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979942    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979944    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979948    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979952    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979955    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979958    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979960    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979963    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 03:48:19.986251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979966    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979970    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979972    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979975    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979979    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979982    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979987    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979990    2558 flags.go:64] FLAG: --lock-file=""
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979993    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979995    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.979998    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980005    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980008    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980011    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980013    2558 flags.go:64] FLAG: --logging-format="text"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980016    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980020    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980023    2558 flags.go:64] FLAG: --manifest-url=""
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980026    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980030    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980033    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980037    2558 flags.go:64] FLAG: --max-pods="110"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980042    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980045    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980048    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 03:48:19.986883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980051    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980053    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980057    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980060    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980067    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980070    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980073    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980076    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980079    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980085    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980088    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980092    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980096    2558 flags.go:64] FLAG: --port="10250"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980099    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980102    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d97d915bfd08a8ef"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980106    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980109    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980112    2558 flags.go:64] FLAG: --register-node="true"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980114    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980118    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980121    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980124    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980127    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980131    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980134    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 03:48:19.987485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980137    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980140    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980143    2558 flags.go:64] FLAG: --runonce="false"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980146    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980150    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980153    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980156    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980159    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980162    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980165    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980168    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980171    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980173    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980176    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980179    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980182    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980193    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980196    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980202    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980206    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980209    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980213    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980217    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980219    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980222    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 03:48:19.988115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980225    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980228    2558 flags.go:64] FLAG: --v="2"
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980233    2558 flags.go:64] FLAG: --version="false"
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980237    2558 flags.go:64] FLAG: --vmodule=""
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980240    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980244    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980361    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980365    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980369    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980373    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980376    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980381    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980384    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980386    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980389    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980391    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980394    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980397    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980399    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980402    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:19.988741 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980404    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980407    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980409    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980412    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980414    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980417    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980420    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980423    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980425    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980428    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980431    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980434    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980436    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980439    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980441    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980444    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980447    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980449    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980452    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980455    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980457    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:19.989258 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980460    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980463    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980466    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980470    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980474    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980477    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980479    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980482    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980485    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980487    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980504    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980510    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980513    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980517    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980520    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980523    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980526    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980529    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980532    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:19.989857 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980534    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980537    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980540    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980548    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980551    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980553    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980556    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980559    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980561    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980564    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980567    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980569    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980572    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980574    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980577    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980581    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980584    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980586    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980589    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980591    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:19.990321 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980594    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980596    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980599    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980602    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980604    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980606    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980610    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980613    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980616    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980619    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980622    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980625    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980627    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980631    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980634    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980636    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980639    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980642    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980644    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980647    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:19.990814 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980649    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980652    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980654    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980656    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.980660    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.980666    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.987972    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.987990    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.988010    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.988016    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988072    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988077    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988080    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988083    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988087    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:19.991296 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988090    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988093    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988096    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988099    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988102    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988105    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988108    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988110    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988114    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988116    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988119    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988122    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988125    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988128    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988131    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988133    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988136    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988139    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988142    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988144    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:19.991690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988147    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988150    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988153    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988155    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988159    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988162    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988165    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988168    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988170    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988173    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988175    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988178    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988180    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988183    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988194    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988197    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988200    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988203    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988206    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988208    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:19.992161 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988211    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988214    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988216    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988219    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988223    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988227    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988231    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988234    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988237    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988239    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988242    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988244    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988247    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988250    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988253    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988256    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988260    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988265    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988269    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:19.992707 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988272    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988275    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988277    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988280    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988283    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988285    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988288    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988290    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988293    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988296    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988298    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988301    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988303    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988306    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988309    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988311    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988314    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988317    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988319    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988322    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:19.993169 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988325    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988327    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988330    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988332    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988335    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988338    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988340    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988343    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988345    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988348    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988351    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988354    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988357    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988361    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988364    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:19.993743 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.988370    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988484    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988504    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988509    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988512    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988515    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988517    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988520    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988522    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988525    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988528    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988531    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988533    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988536    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988539    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988542    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988544    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988548    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988550    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988553    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:19.994171 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988555    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988558    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988561    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988564    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988566    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988569    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988572    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988575    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988577    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988581    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988583    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988586    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988588    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988591    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988594    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988597    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988599    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988603    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988606    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988609    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:19.994702 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988612    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988616    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988618    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988621    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988624    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988626    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988630    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988633    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988636    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988639    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988641    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988643    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988646    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988649    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988652    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988655    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988657    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988660    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988662    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:19.995566 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988665    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988667    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988670    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988673    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988675    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988678    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988680    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988683    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988685    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988688    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988690    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988693    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988695    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988698    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988700    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988703    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988706    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988709    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988711    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988713    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:19.996228 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988716    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988718    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988721    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988724    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988726    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988729    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988731    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988734    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988736    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988739    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988743    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988746    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988749    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988753    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988756    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988758    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988762    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988765    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988768    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:19.996825 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988770    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:19.997304 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:19.988773    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:19.997304 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.988778    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:19.997304 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.988915    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 03:48:19.997304 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.992167    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 03:48:19.997304 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.993891    2558 server.go:1019] "Starting client certificate rotation"
Jul 11 03:48:19.997304 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.994013    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 03:48:19.997304 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.995014    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 03:48:19.998771 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.998752    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 03:48:20.000000 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:19.999981    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 03:48:20.009972 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.009952    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 11 03:48:20.012651 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.012634    2558 log.go:25] "Validated CRI v1 image API"
Jul 11 03:48:20.013421 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.013403    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 03:48:20.016082 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.016061    2558 fs.go:135] Filesystem UUIDs: map[13d76d45-7ef2-4ad7-b849-dccf1b300bef:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c1134727-7e46-4e15-b44a-cbcad5db50b2:/dev/nvme0n1p4]
Jul 11 03:48:20.016157 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.016080    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 03:48:20.022439 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.022421    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 03:48:20.022926 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.022815    2558 manager.go:216] Machine: {Timestamp:2026-07-11 03:48:20.020595413 +0000 UTC m=+0.368505772 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100168 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2136a2054492466b21860587efa304 SystemUUID:ec2136a2-0544-9246-6b21-860587efa304 BootID:f400ef3c-cb91-472a-90b4-b7c470d12841 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:ae:fc:9c:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:ae:fc:9c:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:d8:0a:3a:34:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 03:48:20.022926 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.022922    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 03:48:20.023028 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.023017    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 03:48:20.024318 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.024294    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 03:48:20.024466 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.024321    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 03:48:20.025991 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.025979    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 03:48:20.026030 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.025993    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 03:48:20.026030 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.026001    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 03:48:20.026857 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.026846    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 03:48:20.028767 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.028755    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 03:48:20.033475 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.033457    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 03:48:20.033613 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.033602    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 03:48:20.033664 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.033637    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 03:48:20.033664 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.033647    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 03:48:20.033664 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.033662    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 03:48:20.033769 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.033674    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 11 03:48:20.033769 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.033683    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 03:48:20.034146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.034123    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 03:48:20.034231 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.034163    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 03:48:20.036796 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.036776    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 03:48:20.046140 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.046108    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 03:48:20.046140 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.046126    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 03:48:20.062183 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.062150    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mwdjv"
Jul 11 03:48:20.068989 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.068968    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mwdjv"
Jul 11 03:48:20.182340 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182263    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 03:48:20.182340 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182306    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 03:48:20.182586 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182573    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 03:48:20.182645 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182594    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 03:48:20.182645 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182604    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 03:48:20.182645 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182612    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 03:48:20.182645 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182624    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 03:48:20.182645 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.182633    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 03:48:20.183153 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.183144    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 03:48:20.183201 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.183156    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 03:48:20.183201 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.183168    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 03:48:20.183201 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.183177    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 03:48:20.183201 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.183191    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 03:48:20.183324 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.183203    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 03:48:20.184074 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.184064    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 03:48:20.184136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.184077    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 03:48:20.187179 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.187161    2558 server.go:1268] "Started kubelet"
Jul 11 03:48:20.187295 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.187262    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 03:48:20.187341 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.187255    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 03:48:20.187392 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.187338    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 03:48:20.188037 ip-10-0-138-121 systemd[1]: Started Kubernetes Kubelet.
Jul 11 03:48:20.189181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.189168    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 03:48:20.190281 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.190260    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 03:48:20.196599 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.196576    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 03:48:20.196599 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.196599    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 03:48:20.196743 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.196695    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:20.197140 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.197116    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 03:48:20.197605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.197375    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 03:48:20.197605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.197394    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 03:48:20.197605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.197554    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 03:48:20.197605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.197562    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 03:48:20.197605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.197580    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 03:48:20.198746 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.198728    2558 factory.go:55] Registering systemd factory
Jul 11 03:48:20.198843 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.198824    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:20.198937 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.198927    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 11 03:48:20.199482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.199466    2558 factory.go:153] Registering CRI-O factory
Jul 11 03:48:20.199482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.199484    2558 factory.go:223] Registration of the crio container factory successfully
Jul 11 03:48:20.199620 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.199552    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 03:48:20.199620 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.199578    2558 factory.go:103] Registering Raw factory
Jul 11 03:48:20.199620 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.199592    2558 manager.go:1196] Started watching for new ooms in manager
Jul 11 03:48:20.200322 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.200271    2558 manager.go:349] Starting recovery of all containers
Jul 11 03:48:20.202041 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.202023    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-121.ec2.internal" not found
Jul 11 03:48:20.202125 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.202086    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-121.ec2.internal\" not found" node="ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.211308 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.211284    2558 manager.go:354] Recovery completed
Jul 11 03:48:20.216784 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.216762    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-121.ec2.internal" not found
Jul 11 03:48:20.216784 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.216786    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:20.219100 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.219082    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:20.219176 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.219113    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:20.219176 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.219126    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:20.219712 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.219698    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 03:48:20.219712 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.219711    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 03:48:20.219796 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.219728    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 03:48:20.219832 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.219713    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:20.220504 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.220480    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:20.220552 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.220522    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:20.220552 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.220534    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:20.221950 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.221936    2558 policy_none.go:49] "None policy: Start"
Jul 11 03:48:20.221950 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.221952    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 03:48:20.222059 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.221962    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 03:48:20.223909 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.223897    2558 policy_none.go:47] "Start"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.265952    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.267312    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.267363    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.267389    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.267430    2558 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269278    2558 manager.go:337] "Starting Device Plugin manager"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.269330    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269344    2558 server.go:87] "Starting device plugin registration server"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269548    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269675    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269692    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269852    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269930    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.269938    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.270663    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 03:48:20.271181 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.270716    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:20.275507 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.275477    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-121.ec2.internal" not found
Jul 11 03:48:20.367904 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.367870    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"]
Jul 11 03:48:20.368037 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.367956    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:20.369736 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.369718    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:20.369840 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.369747    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:20.369840 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.369757    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:20.369840 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.369763    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:20.370889 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.370870    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:20.370965 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.370901    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:20.370965 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.370914    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:20.370965 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.370934    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.372200 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372180    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:20.372298 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372285    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.372345 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372314    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:20.372922 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372894    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:20.372922 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372906    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:20.372922 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372924    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:20.373086 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372929    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:20.373086 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372938    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:20.373086 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.372942    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:20.375280 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.375265    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.375352 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.375298    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:20.375975 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.375957    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:20.376091 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.375984    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:20.376091 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.375995    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:20.379594 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.379575    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.379682 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.379597    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-121.ec2.internal\": node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:20.396177 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.396150    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-121.ec2.internal\" not found" node="ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.397780 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.397760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec96949558917645dae8243207f7883f-config\") pod \"kube-apiserver-proxy-ip-10-0-138-121.ec2.internal\" (UID: \"ec96949558917645dae8243207f7883f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.397901 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.397783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbc85f4be24135dbe6a7c4e3d27571e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"dbc85f4be24135dbe6a7c4e3d27571e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.397901 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.397801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbc85f4be24135dbe6a7c4e3d27571e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"dbc85f4be24135dbe6a7c4e3d27571e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.400193 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.400171    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-121.ec2.internal\" not found" node="ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.401931 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.401917    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:20.498913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.498840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec96949558917645dae8243207f7883f-config\") pod \"kube-apiserver-proxy-ip-10-0-138-121.ec2.internal\" (UID: \"ec96949558917645dae8243207f7883f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.498913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.498870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbc85f4be24135dbe6a7c4e3d27571e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"dbc85f4be24135dbe6a7c4e3d27571e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.498913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.498899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbc85f4be24135dbe6a7c4e3d27571e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"dbc85f4be24135dbe6a7c4e3d27571e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.499083 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.498938    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec96949558917645dae8243207f7883f-config\") pod \"kube-apiserver-proxy-ip-10-0-138-121.ec2.internal\" (UID: \"ec96949558917645dae8243207f7883f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.499083 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.498954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbc85f4be24135dbe6a7c4e3d27571e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"dbc85f4be24135dbe6a7c4e3d27571e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.499083 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:20.498937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbc85f4be24135dbe6a7c4e3d27571e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal\" (UID: \"dbc85f4be24135dbe6a7c4e3d27571e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:20.502944 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.502929    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:20.603741 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:20.603701    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:21.963303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:21.963273    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:21.968482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:21.968395    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:21.968482 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:21.968404    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:22.069195 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:22.069088    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:22.169645 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:22.169600    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:22.257843 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.257814    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 03:48:22.258286 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.257969    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 03:48:22.258286 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.257971    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 03:48:22.270398 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:22.270365    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:22.339865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.339766    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 03:43:21 +0000 UTC" deadline="2028-04-26 04:25:17.047483726 +0000 UTC"
Jul 11 03:48:22.339865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.339819    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15720h36m54.707669229s"
Jul 11 03:48:22.371283 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:22.371228    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-121.ec2.internal\" not found"
Jul 11 03:48:22.419323 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.419295    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:22.461341 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.461298    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:22.461341 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.461333    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 03:48:22.470194 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.470174    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 03:48:22.472107 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.472086    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal"
Jul 11 03:48:22.473941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.473892    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 03:48:22.485036 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.485017    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 03:48:22.492410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.492387    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4kpz"
Jul 11 03:48:22.499371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.499354    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d4kpz"
Jul 11 03:48:22.542039 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.542014    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:22.609983 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:22.609936    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec96949558917645dae8243207f7883f.slice/crio-5e312837d21f88a5d7a3c08b97e60df62f3a16bc5c0824d05aba11858898bae7 WatchSource:0}: Error finding container 5e312837d21f88a5d7a3c08b97e60df62f3a16bc5c0824d05aba11858898bae7: Status 404 returned error can't find the container with id 5e312837d21f88a5d7a3c08b97e60df62f3a16bc5c0824d05aba11858898bae7
Jul 11 03:48:22.613815 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:22.613787    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 03:48:23.299141 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.299107    2558 apiserver.go:52] "Watching apiserver"
Jul 11 03:48:23.314103 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.314075    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 03:48:23.315527 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.315494    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-2h7hm","openshift-network-operator/iptables-alerter-5fplq","kube-system/global-pull-secret-syncer-bwfm4","kube-system/konnectivity-agent-hlxkm","openshift-cluster-node-tuning-operator/tuned-b8szj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal","openshift-network-diagnostics/network-check-target-5ngx7","openshift-ovn-kubernetes/ovnkube-node-8wrw6","kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54","openshift-dns/node-resolver-ns77x","openshift-image-registry/node-ca-66bch","openshift-multus/multus-4w2w5","openshift-multus/multus-additional-cni-plugins-zz5xh"]
Jul 11 03:48:23.318115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.318093    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.320406 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.320387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.320522 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.320500    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rkc6p\""
Jul 11 03:48:23.320866 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.320704    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 03:48:23.320866 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.320727    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 03:48:23.320866 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.320740    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 03:48:23.322576 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.322554    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.322885 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.322866    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 03:48:23.323193 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.323175    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 03:48:23.323284 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.323204    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lbxmz\""
Jul 11 03:48:23.323284 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.323249    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 03:48:23.323467 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.323446    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 03:48:23.324695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.324679    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 03:48:23.325117 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.324860    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.325594 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.325320    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jq2l5\""
Jul 11 03:48:23.325594 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.325335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 03:48:23.327380 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.327363    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 03:48:23.327457 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.327425    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 03:48:23.327515 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.327463    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6wgwp\""
Jul 11 03:48:23.327633 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.327618    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.329780 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.329760    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:23.330101 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.330083    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4j5f2\""
Jul 11 03:48:23.330190 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.330174    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.330250 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.330177    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:23.332161 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.332142    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.333308 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.333179    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 03:48:23.333308 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.333234    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 03:48:23.333308 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.333259    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 03:48:23.333916 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.333896    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 03:48:23.333916 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.333906    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 03:48:23.334224 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.334055    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 03:48:23.334224 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.334170    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lcm2j\""
Jul 11 03:48:23.334520 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.334495    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.334677 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.334619    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 03:48:23.334677 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.334643    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8kkdx\""
Jul 11 03:48:23.334847 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.334830    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 03:48:23.334916 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.334872    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 03:48:23.336725 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.336707    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 03:48:23.337308 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.337156    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 03:48:23.337412 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.337347    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7pq4s\""
Jul 11 03:48:23.337474 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.337427    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:23.337580 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.337508    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:23.339938 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.339640    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.341997 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.341975    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f422c\""
Jul 11 03:48:23.342091 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.342031    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:23.342285 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.342269    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:23.342346 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.342331    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:23.342774 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.342755    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:23.342881 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.342866    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 03:48:23.345362 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.345338    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.347143 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.345715    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:23.362916 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.362892    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 03:48:23.371049 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-systemd\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.371163 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.371163 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-netns\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.371163 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-host\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.371163 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371134    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff580988-4c06-4316-8934-f892f2338b83-etc-tuned\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.371163 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-serviceca\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f73d5ad8-1841-416f-b68a-d0448ee74801-iptables-alerter-script\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-etc-kubernetes\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-cnibin\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42p5b\" (UniqueName: \"kubernetes.io/projected/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-kube-api-access-42p5b\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysconfig\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-lib-modules\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371387    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a767922-f3e8-4f33-b2ff-f3e317d27798-cni-binary-copy\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.371423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-conf-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-run-netns\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-var-lib-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-cni-bin\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovnkube-config\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-kubelet\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysctl-conf\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-hostroot\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-modprobe-d\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.371753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f73d5ad8-1841-416f-b68a-d0448ee74801-host-slash\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-node-log\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovn-node-metrics-cert\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f826c89f-a3e2-4bae-a739-3210cc93e955-agent-certs\") pod \"konnectivity-agent-hlxkm\" (UID: \"f826c89f-a3e2-4bae-a739-3210cc93e955\") " pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-os-release\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-device-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371959    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-multus-certs\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.371983    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f826c89f-a3e2-4bae-a739-3210cc93e955-konnectivity-ca\") pod \"konnectivity-agent-hlxkm\" (UID: \"f826c89f-a3e2-4bae-a739-3210cc93e955\") " pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372058    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovnkube-script-lib\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjbm\" (UniqueName: \"kubernetes.io/projected/f73d5ad8-1841-416f-b68a-d0448ee74801-kube-api-access-xdjbm\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-systemd-units\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-etc-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45ab04ec-23fa-472b-8d12-4922b35c0107-hosts-file\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.372371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-cni-bin\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-cni-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-cni-multus\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-run\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41dfa086-33fd-4a06-be28-9f8954c06cce-kubelet-config\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-kubelet\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372387    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-slash\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45ab04ec-23fa-472b-8d12-4922b35c0107-tmp-dir\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41dfa086-33fd-4a06-be28-9f8954c06cce-dbus\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqs5q\" (UniqueName: \"kubernetes.io/projected/2a767922-f3e8-4f33-b2ff-f3e317d27798-kube-api-access-fqs5q\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-registration-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-system-cni-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-daemon-config\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372589    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysctl-d\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-systemd\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-env-overrides\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-socket-dir-parent\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-host\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdxs4\" (UniqueName: \"kubernetes.io/projected/ff580988-4c06-4316-8934-f892f2338b83-kube-api-access-zdxs4\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372746    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-os-release\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-ovn\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-log-socket\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-kubernetes\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372903    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdp2g\" (UniqueName: \"kubernetes.io/projected/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-kube-api-access-sdp2g\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372927    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-system-cni-dir\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.372975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lbwr\" (UniqueName: \"kubernetes.io/projected/0dbda28d-cbec-4d78-8a09-5448ec9174be-kube-api-access-9lbwr\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff580988-4c06-4316-8934-f892f2338b83-tmp\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5zb\" (UniqueName: \"kubernetes.io/projected/7d465f22-313f-42b6-b381-08efae2a0ecb-kube-api-access-dc5zb\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-cni-netd\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-sys-fs\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-k8s-cni-cncf-io\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.373729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-cnibin\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.374435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mt76\" (UniqueName: \"kubernetes.io/projected/268cd590-e93d-4e86-b011-3a28a0159167-kube-api-access-4mt76\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:23.374435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-etc-selinux\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.374435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-sys\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.374435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-var-lib-kubelet\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.374435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9fc\" (UniqueName: \"kubernetes.io/projected/45ab04ec-23fa-472b-8d12-4922b35c0107-kube-api-access-4b9fc\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.374435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373332    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:23.374435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.373358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-socket-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.396887 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.396861    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:23.474313 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.474313 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-netns\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-host\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.474548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff580988-4c06-4316-8934-f892f2338b83-etc-tuned\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.474548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-netns\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-serviceca\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.474548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f73d5ad8-1841-416f-b68a-d0448ee74801-iptables-alerter-script\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.474548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-etc-kubernetes\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-cnibin\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42p5b\" (UniqueName: \"kubernetes.io/projected/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-kube-api-access-42p5b\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-etc-kubernetes\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysconfig\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-lib-modules\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysconfig\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a767922-f3e8-4f33-b2ff-f3e317d27798-cni-binary-copy\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474686    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-conf-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-cnibin\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474736    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-run-netns\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-var-lib-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.474865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474854    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-cni-bin\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovnkube-config\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474902    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-kubelet\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysctl-conf\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474977    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-run-netns\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-hostroot\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-modprobe-d\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f73d5ad8-1841-416f-b68a-d0448ee74801-host-slash\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475072    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-serviceca\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-lib-modules\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-hostroot\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-kubelet\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-modprobe-d\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f73d5ad8-1841-416f-b68a-d0448ee74801-host-slash\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.475583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.474544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-host\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475504    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-conf-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-node-log\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovn-node-metrics-cert\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f826c89f-a3e2-4bae-a739-3210cc93e955-agent-certs\") pod \"konnectivity-agent-hlxkm\" (UID: \"f826c89f-a3e2-4bae-a739-3210cc93e955\") " pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a767922-f3e8-4f33-b2ff-f3e317d27798-cni-binary-copy\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-os-release\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-device-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-multus-certs\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f826c89f-a3e2-4bae-a739-3210cc93e955-konnectivity-ca\") pod \"konnectivity-agent-hlxkm\" (UID: \"f826c89f-a3e2-4bae-a739-3210cc93e955\") " pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovnkube-script-lib\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475778    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysctl-conf\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjbm\" (UniqueName: \"kubernetes.io/projected/f73d5ad8-1841-416f-b68a-d0448ee74801-kube-api-access-xdjbm\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.476564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-cni-bin\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-multus-certs\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-node-log\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.476038    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f73d5ad8-1841-416f-b68a-d0448ee74801-iptables-alerter-script\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.476249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-var-lib-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovnkube-config\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.475858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-systemd-units\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.476320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.476717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-os-release\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.476790    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.476895    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret podName:41dfa086-33fd-4a06-be28-9f8954c06cce nodeName:}" failed. No retries permitted until 2026-07-11 03:48:23.976876563 +0000 UTC m=+3.060478853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret") pod "global-pull-secret-syncer-bwfm4" (UID: "41dfa086-33fd-4a06-be28-9f8954c06cce") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f826c89f-a3e2-4bae-a739-3210cc93e955-konnectivity-ca\") pod \"konnectivity-agent-hlxkm\" (UID: \"f826c89f-a3e2-4bae-a739-3210cc93e955\") " pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-etc-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-device-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45ab04ec-23fa-472b-8d12-4922b35c0107-hosts-file\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-cni-bin\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-cni-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.477410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-cni-multus\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-run\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41dfa086-33fd-4a06-be28-9f8954c06cce-kubelet-config\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-kubelet\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-slash\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45ab04ec-23fa-472b-8d12-4922b35c0107-tmp-dir\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41dfa086-33fd-4a06-be28-9f8954c06cce-dbus\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovnkube-script-lib\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqs5q\" (UniqueName: \"kubernetes.io/projected/2a767922-f3e8-4f33-b2ff-f3e317d27798-kube-api-access-fqs5q\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-registration-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-system-cni-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-daemon-config\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysctl-d\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477574    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-cni-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477605    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-systemd\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477620    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41dfa086-33fd-4a06-be28-9f8954c06cce-kubelet-config\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-env-overrides\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-socket-dir-parent\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.478269 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45ab04ec-23fa-472b-8d12-4922b35c0107-hosts-file\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-host\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-systemd-units\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdxs4\" (UniqueName: \"kubernetes.io/projected/ff580988-4c06-4316-8934-f892f2338b83-kube-api-access-zdxs4\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-etc-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-os-release\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-ovn\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-log-socket\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-kubernetes\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdp2g\" (UniqueName: \"kubernetes.io/projected/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-kube-api-access-sdp2g\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.477886    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-system-cni-dir\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-sysctl-d\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-cni-multus\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-run\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478145    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-kubelet\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-slash\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.479111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-var-lib-cni-bin\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lbwr\" (UniqueName: \"kubernetes.io/projected/0dbda28d-cbec-4d78-8a09-5448ec9174be-kube-api-access-9lbwr\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff580988-4c06-4316-8934-f892f2338b83-tmp\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5zb\" (UniqueName: \"kubernetes.io/projected/7d465f22-313f-42b6-b381-08efae2a0ecb-kube-api-access-dc5zb\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478349    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-daemon-config\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478396    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-host\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478423    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-systemd\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478474    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45ab04ec-23fa-472b-8d12-4922b35c0107-tmp-dir\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-os-release\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-etc-kubernetes\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478558    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-multus-socket-dir-parent\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-openvswitch\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-registration-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-system-cni-dir\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-cni-netd\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.480001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0dbda28d-cbec-4d78-8a09-5448ec9174be-env-overrides\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.478894    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff580988-4c06-4316-8934-f892f2338b83-etc-tuned\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-host-cni-netd\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41dfa086-33fd-4a06-be28-9f8954c06cce-dbus\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-sys-fs\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-k8s-cni-cncf-io\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-cnibin\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a767922-f3e8-4f33-b2ff-f3e317d27798-host-run-k8s-cni-cncf-io\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mt76\" (UniqueName: \"kubernetes.io/projected/268cd590-e93d-4e86-b011-3a28a0159167-kube-api-access-4mt76\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-sys-fs\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-cnibin\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-etc-selinux\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-sys\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-var-lib-kubelet\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9fc\" (UniqueName: \"kubernetes.io/projected/45ab04ec-23fa-472b-8d12-4922b35c0107-kube-api-access-4b9fc\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.480030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d465f22-313f-42b6-b381-08efae2a0ecb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.480792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-sys\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.481590 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.480512    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-log-socket\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.481590 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.480564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-ovn\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.481590 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.480594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-socket-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.481590 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.480627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-systemd\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.481590 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.480716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0dbda28d-cbec-4d78-8a09-5448ec9174be-run-systemd\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.481590 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.480838    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-socket-dir\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.481882 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.481748    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:23.481882 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.481836    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs podName:268cd590-e93d-4e86-b011-3a28a0159167 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:23.981812924 +0000 UTC m=+3.065415227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs") pod "network-metrics-daemon-2h7hm" (UID: "268cd590-e93d-4e86-b011-3a28a0159167") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:23.481882 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.481845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-etc-selinux\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.481882 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.479484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d465f22-313f-42b6-b381-08efae2a0ecb-system-cni-dir\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.482074 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.481943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff580988-4c06-4316-8934-f892f2338b83-var-lib-kubelet\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.482128 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.482108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dbda28d-cbec-4d78-8a09-5448ec9174be-ovn-node-metrics-cert\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.482932 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.482215    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f826c89f-a3e2-4bae-a739-3210cc93e955-agent-certs\") pod \"konnectivity-agent-hlxkm\" (UID: \"f826c89f-a3e2-4bae-a739-3210cc93e955\") " pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.486296 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.486091    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:23.486296 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.486112    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:23.486296 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.486126    2558 projected.go:196] Error preparing data for projected volume kube-api-access-mscwx for pod openshift-network-diagnostics/network-check-target-5ngx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:23.486296 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.486205    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx podName:e813390b-c978-4422-81a9-d2f15e38f13b nodeName:}" failed. No retries permitted until 2026-07-11 03:48:23.986188139 +0000 UTC m=+3.069790429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mscwx" (UniqueName: "kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx") pod "network-check-target-5ngx7" (UID: "e813390b-c978-4422-81a9-d2f15e38f13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:23.489136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.489096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42p5b\" (UniqueName: \"kubernetes.io/projected/bc1b9d1c-72dd-401c-9119-4c329c55dfb2-kube-api-access-42p5b\") pod \"aws-ebs-csi-driver-node-25s54\" (UID: \"bc1b9d1c-72dd-401c-9119-4c329c55dfb2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.491542 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.491498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff580988-4c06-4316-8934-f892f2338b83-tmp\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.491710 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.491549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjbm\" (UniqueName: \"kubernetes.io/projected/f73d5ad8-1841-416f-b68a-d0448ee74801-kube-api-access-xdjbm\") pod \"iptables-alerter-5fplq\" (UID: \"f73d5ad8-1841-416f-b68a-d0448ee74801\") " pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.492762 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.492578    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lbwr\" (UniqueName: \"kubernetes.io/projected/0dbda28d-cbec-4d78-8a09-5448ec9174be-kube-api-access-9lbwr\") pod \"ovnkube-node-8wrw6\" (UID: \"0dbda28d-cbec-4d78-8a09-5448ec9174be\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.492762 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.492591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdp2g\" (UniqueName: \"kubernetes.io/projected/c6b9e593-44c1-433a-ad4f-046bf0d4e69a-kube-api-access-sdp2g\") pod \"node-ca-66bch\" (UID: \"c6b9e593-44c1-433a-ad4f-046bf0d4e69a\") " pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.493850 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.493827    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mt76\" (UniqueName: \"kubernetes.io/projected/268cd590-e93d-4e86-b011-3a28a0159167-kube-api-access-4mt76\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:23.493933 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.493919    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5zb\" (UniqueName: \"kubernetes.io/projected/7d465f22-313f-42b6-b381-08efae2a0ecb-kube-api-access-dc5zb\") pod \"multus-additional-cni-plugins-zz5xh\" (UID: \"7d465f22-313f-42b6-b381-08efae2a0ecb\") " pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.494345 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.494318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqs5q\" (UniqueName: \"kubernetes.io/projected/2a767922-f3e8-4f33-b2ff-f3e317d27798-kube-api-access-fqs5q\") pod \"multus-4w2w5\" (UID: \"2a767922-f3e8-4f33-b2ff-f3e317d27798\") " pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.497251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.497208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdxs4\" (UniqueName: \"kubernetes.io/projected/ff580988-4c06-4316-8934-f892f2338b83-kube-api-access-zdxs4\") pod \"tuned-b8szj\" (UID: \"ff580988-4c06-4316-8934-f892f2338b83\") " pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.497850 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.497825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9fc\" (UniqueName: \"kubernetes.io/projected/45ab04ec-23fa-472b-8d12-4922b35c0107-kube-api-access-4b9fc\") pod \"node-resolver-ns77x\" (UID: \"45ab04ec-23fa-472b-8d12-4922b35c0107\") " pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.503232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.503185    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:43:22 +0000 UTC" deadline="2028-01-30 13:47:32.642984641 +0000 UTC"
Jul 11 03:48:23.503320 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.503233    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13641h59m9.139755951s"
Jul 11 03:48:23.537052 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.536963    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" event={"ID":"dbc85f4be24135dbe6a7c4e3d27571e7","Type":"ContainerStarted","Data":"2aad6b7bdee47af19569f2d6a377ff2e8d579bcb5795bf8775a75339424d1240"}
Jul 11 03:48:23.538248 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.538219    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal" event={"ID":"ec96949558917645dae8243207f7883f","Type":"ContainerStarted","Data":"5e312837d21f88a5d7a3c08b97e60df62f3a16bc5c0824d05aba11858898bae7"}
Jul 11 03:48:23.570208 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.570123    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:23.630715 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.630683    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54"
Jul 11 03:48:23.639550 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.639523    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4w2w5"
Jul 11 03:48:23.650697 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.650670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zz5xh"
Jul 11 03:48:23.657883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.657859    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:23.664941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.664913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8szj"
Jul 11 03:48:23.674018 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.673936    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:23.679840 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.679818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-66bch"
Jul 11 03:48:23.688565 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.688542    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ns77x"
Jul 11 03:48:23.697105 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.697081    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fplq"
Jul 11 03:48:23.984889 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.984792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:23.984889 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:23.984867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:23.985143 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.984958    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:23.985143 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.985022    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs podName:268cd590-e93d-4e86-b011-3a28a0159167 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:24.985004686 +0000 UTC m=+4.068606977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs") pod "network-metrics-daemon-2h7hm" (UID: "268cd590-e93d-4e86-b011-3a28a0159167") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:23.985143 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.984958    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:23.985143 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:23.985136    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret podName:41dfa086-33fd-4a06-be28-9f8954c06cce nodeName:}" failed. No retries permitted until 2026-07-11 03:48:24.985113047 +0000 UTC m=+4.068715355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret") pod "global-pull-secret-syncer-bwfm4" (UID: "41dfa086-33fd-4a06-be28-9f8954c06cce") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:24.085686 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:24.085649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:24.085901 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.085832    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:24.085901 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.085860    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:24.085901 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.085874    2558 projected.go:196] Error preparing data for projected volume kube-api-access-mscwx for pod openshift-network-diagnostics/network-check-target-5ngx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:24.086060 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.085928    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx podName:e813390b-c978-4422-81a9-d2f15e38f13b nodeName:}" failed. No retries permitted until 2026-07-11 03:48:25.085913901 +0000 UTC m=+4.169516191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mscwx" (UniqueName: "kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx") pod "network-check-target-5ngx7" (UID: "e813390b-c978-4422-81a9-d2f15e38f13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:24.504143 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:24.504108    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:43:22 +0000 UTC" deadline="2028-02-24 03:10:13.408196168 +0000 UTC"
Jul 11 03:48:24.504143 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:24.504136    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14231h21m48.90406424s"
Jul 11 03:48:24.581629 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:24.581592    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf826c89f_a3e2_4bae_a739_3210cc93e955.slice/crio-4d22da7cb35904d5eb296026ec6adfc7c6376f0b1cefe17c46b23e9e1bbe952c WatchSource:0}: Error finding container 4d22da7cb35904d5eb296026ec6adfc7c6376f0b1cefe17c46b23e9e1bbe952c: Status 404 returned error can't find the container with id 4d22da7cb35904d5eb296026ec6adfc7c6376f0b1cefe17c46b23e9e1bbe952c
Jul 11 03:48:24.603148 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:24.603123    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b9e593_44c1_433a_ad4f_046bf0d4e69a.slice/crio-97f8b6b5f9a02a54b99d6fe9f967fb1a23fc0415ba56dd19d9c0174e05083ac6 WatchSource:0}: Error finding container 97f8b6b5f9a02a54b99d6fe9f967fb1a23fc0415ba56dd19d9c0174e05083ac6: Status 404 returned error can't find the container with id 97f8b6b5f9a02a54b99d6fe9f967fb1a23fc0415ba56dd19d9c0174e05083ac6
Jul 11 03:48:24.604186 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:24.604156    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff580988_4c06_4316_8934_f892f2338b83.slice/crio-97eb2d61aa17c43b94eff489bea6011b949d4a254b3320711ecd4ba2e9843b95 WatchSource:0}: Error finding container 97eb2d61aa17c43b94eff489bea6011b949d4a254b3320711ecd4ba2e9843b95: Status 404 returned error can't find the container with id 97eb2d61aa17c43b94eff489bea6011b949d4a254b3320711ecd4ba2e9843b95
Jul 11 03:48:24.605038 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:24.605013    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d465f22_313f_42b6_b381_08efae2a0ecb.slice/crio-bdb2162430a86794b5e455ca326d3f51dba44bd31f4be773ac4301e4bfb54502 WatchSource:0}: Error finding container bdb2162430a86794b5e455ca326d3f51dba44bd31f4be773ac4301e4bfb54502: Status 404 returned error can't find the container with id bdb2162430a86794b5e455ca326d3f51dba44bd31f4be773ac4301e4bfb54502
Jul 11 03:48:24.605662 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:24.605637    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ab04ec_23fa_472b_8d12_4922b35c0107.slice/crio-c3417099c4218d9e7b6063466684644724866b84f3f2cb5b05e0cc7ee329e6f5 WatchSource:0}: Error finding container c3417099c4218d9e7b6063466684644724866b84f3f2cb5b05e0cc7ee329e6f5: Status 404 returned error can't find the container with id c3417099c4218d9e7b6063466684644724866b84f3f2cb5b05e0cc7ee329e6f5
Jul 11 03:48:24.606555 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:24.606533    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbda28d_cbec_4d78_8a09_5448ec9174be.slice/crio-83216e429c72a8d0dbce776cb44380a00b104b360b40d59f32b6b3c1eb1e7d1c WatchSource:0}: Error finding container 83216e429c72a8d0dbce776cb44380a00b104b360b40d59f32b6b3c1eb1e7d1c: Status 404 returned error can't find the container with id 83216e429c72a8d0dbce776cb44380a00b104b360b40d59f32b6b3c1eb1e7d1c
Jul 11 03:48:24.608564 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:24.608534    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73d5ad8_1841_416f_b68a_d0448ee74801.slice/crio-909806c484f6e6de42c4fba1da064f5b2b169d2c38fa87cdc0e07bc08c341be2 WatchSource:0}: Error finding container 909806c484f6e6de42c4fba1da064f5b2b169d2c38fa87cdc0e07bc08c341be2: Status 404 returned error can't find the container with id 909806c484f6e6de42c4fba1da064f5b2b169d2c38fa87cdc0e07bc08c341be2
Jul 11 03:48:24.994089 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:24.993828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:24.994303 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.993991    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:24.994303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:24.994128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:24.994303 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.994181    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs podName:268cd590-e93d-4e86-b011-3a28a0159167 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:26.994150377 +0000 UTC m=+6.077752669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs") pod "network-metrics-daemon-2h7hm" (UID: "268cd590-e93d-4e86-b011-3a28a0159167") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:24.994303 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.994241    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:24.994303 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:24.994292    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret podName:41dfa086-33fd-4a06-be28-9f8954c06cce nodeName:}" failed. No retries permitted until 2026-07-11 03:48:26.994268494 +0000 UTC m=+6.077870784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret") pod "global-pull-secret-syncer-bwfm4" (UID: "41dfa086-33fd-4a06-be28-9f8954c06cce") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:25.047097 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.047043    2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087"
Jul 11 03:48:25.047259 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.047181    2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-5fplq_openshift-network-operator(f73d5ad8-1841-416f-b68a-d0448ee74801): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 11 03:48:25.047259 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.047217    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-network-operator/iptables-alerter-5fplq" podUID="f73d5ad8-1841-416f-b68a-d0448ee74801"
Jul 11 03:48:25.095576 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.094892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:25.095576 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.095108    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:25.095576 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.095126    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:25.095576 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.095139    2558 projected.go:196] Error preparing data for projected volume kube-api-access-mscwx for pod openshift-network-diagnostics/network-check-target-5ngx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:25.095576 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.095203    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx podName:e813390b-c978-4422-81a9-d2f15e38f13b nodeName:}" failed. No retries permitted until 2026-07-11 03:48:27.095184558 +0000 UTC m=+6.178786852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mscwx" (UniqueName: "kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx") pod "network-check-target-5ngx7" (UID: "e813390b-c978-4422-81a9-d2f15e38f13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:25.533173 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.532380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:25.533173 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.532524    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:25.533173 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.532959    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:25.533173 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.533066    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:25.534141 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.533986    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:25.534141 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.534102    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:25.551501 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.551465    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ns77x" event={"ID":"45ab04ec-23fa-472b-8d12-4922b35c0107","Type":"ContainerStarted","Data":"c3417099c4218d9e7b6063466684644724866b84f3f2cb5b05e0cc7ee329e6f5"}
Jul 11 03:48:25.553521 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.553442    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerStarted","Data":"bdb2162430a86794b5e455ca326d3f51dba44bd31f4be773ac4301e4bfb54502"}
Jul 11 03:48:25.563649 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.563557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hlxkm" event={"ID":"f826c89f-a3e2-4bae-a739-3210cc93e955","Type":"ContainerStarted","Data":"4d22da7cb35904d5eb296026ec6adfc7c6376f0b1cefe17c46b23e9e1bbe952c"}
Jul 11 03:48:25.574882 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.574759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4w2w5" event={"ID":"2a767922-f3e8-4f33-b2ff-f3e317d27798","Type":"ContainerStarted","Data":"bd1532b98ecad0769c644231007ee8fe09b4daf7c58d03bd5fe2f57aa49d13e0"}
Jul 11 03:48:25.588607 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.588468    2558 generic.go:356] "Generic (PLEG): container finished" podID="dbc85f4be24135dbe6a7c4e3d27571e7" containerID="952a2c5c81db6bbbcc18f3888b07176629760a92362ae80f0f884eb387a4b9f9" exitCode=0
Jul 11 03:48:25.588607 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.588575    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" event={"ID":"dbc85f4be24135dbe6a7c4e3d27571e7","Type":"ContainerDied","Data":"952a2c5c81db6bbbcc18f3888b07176629760a92362ae80f0f884eb387a4b9f9"}
Jul 11 03:48:25.594690 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.594657    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal" event={"ID":"ec96949558917645dae8243207f7883f","Type":"ContainerStarted","Data":"3352984202f987621d97a4e145d2cc05b2acd09f71b9aa7a2ac01c65185c2dc8"}
Jul 11 03:48:25.606584 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.606550    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fplq" event={"ID":"f73d5ad8-1841-416f-b68a-d0448ee74801","Type":"ContainerStarted","Data":"909806c484f6e6de42c4fba1da064f5b2b169d2c38fa87cdc0e07bc08c341be2"}
Jul 11 03:48:25.608318 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:25.608283    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-network-operator/iptables-alerter-5fplq" podUID="f73d5ad8-1841-416f-b68a-d0448ee74801"
Jul 11 03:48:25.610345 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.610318    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"83216e429c72a8d0dbce776cb44380a00b104b360b40d59f32b6b3c1eb1e7d1c"}
Jul 11 03:48:25.627762 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.627725    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8szj" event={"ID":"ff580988-4c06-4316-8934-f892f2338b83","Type":"ContainerStarted","Data":"97eb2d61aa17c43b94eff489bea6011b949d4a254b3320711ecd4ba2e9843b95"}
Jul 11 03:48:25.634290 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.631371    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-121.ec2.internal" podStartSLOduration=3.631351359 podStartE2EDuration="3.631351359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:25.618049586 +0000 UTC m=+4.701651919" watchObservedRunningTime="2026-07-11 03:48:25.631351359 +0000 UTC m=+4.714953673"
Jul 11 03:48:25.639306 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.639262    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-66bch" event={"ID":"c6b9e593-44c1-433a-ad4f-046bf0d4e69a","Type":"ContainerStarted","Data":"97f8b6b5f9a02a54b99d6fe9f967fb1a23fc0415ba56dd19d9c0174e05083ac6"}
Jul 11 03:48:25.645984 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:25.645951    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54" event={"ID":"bc1b9d1c-72dd-401c-9119-4c329c55dfb2","Type":"ContainerStarted","Data":"106f73b6989f1d65db37e6a06b1ca4a1635da755f13de176a7291f1ac898a4c8"}
Jul 11 03:48:26.662849 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:26.662772    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" event={"ID":"dbc85f4be24135dbe6a7c4e3d27571e7","Type":"ContainerStarted","Data":"344d22ed40e33fa10aa7b800f7c575099c97927155af55dd4ba0b5152cfd1e5b"}
Jul 11 03:48:26.679293 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:26.678684    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-121.ec2.internal" podStartSLOduration=4.678658984 podStartE2EDuration="4.678658984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:26.677015307 +0000 UTC m=+5.760617622" watchObservedRunningTime="2026-07-11 03:48:26.678658984 +0000 UTC m=+5.762261297"
Jul 11 03:48:27.013149 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:27.012303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:27.013149 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:27.012385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:27.013149 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.012528    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:27.013149 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.012597    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret podName:41dfa086-33fd-4a06-be28-9f8954c06cce nodeName:}" failed. No retries permitted until 2026-07-11 03:48:31.012576155 +0000 UTC m=+10.096178449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret") pod "global-pull-secret-syncer-bwfm4" (UID: "41dfa086-33fd-4a06-be28-9f8954c06cce") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:27.013149 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.013001    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:27.013149 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.013058    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs podName:268cd590-e93d-4e86-b011-3a28a0159167 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:31.013039445 +0000 UTC m=+10.096641737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs") pod "network-metrics-daemon-2h7hm" (UID: "268cd590-e93d-4e86-b011-3a28a0159167") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:27.113929 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:27.113270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:27.113929 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.113497    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:27.113929 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.113520    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:27.113929 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.113531    2558 projected.go:196] Error preparing data for projected volume kube-api-access-mscwx for pod openshift-network-diagnostics/network-check-target-5ngx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:27.113929 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.113587    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx podName:e813390b-c978-4422-81a9-d2f15e38f13b nodeName:}" failed. No retries permitted until 2026-07-11 03:48:31.113567672 +0000 UTC m=+10.197169967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mscwx" (UniqueName: "kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx") pod "network-check-target-5ngx7" (UID: "e813390b-c978-4422-81a9-d2f15e38f13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:27.532123 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:27.532091    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:27.532306 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:27.532091    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:27.532306 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.532235    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:27.532510 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.532471    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:27.532589 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:27.532094    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:27.532645 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:27.532590    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:29.533309 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:29.532831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:29.533309 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:29.532877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:29.533309 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:29.532831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:29.533309 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:29.532982    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:29.533309 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:29.533064    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:29.533309 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:29.533154    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:31.048622 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:31.048581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:31.049139 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:31.048654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:31.049139 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.048765    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:31.049139 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.048784    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:31.049139 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.048866    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret podName:41dfa086-33fd-4a06-be28-9f8954c06cce nodeName:}" failed. No retries permitted until 2026-07-11 03:48:39.048844765 +0000 UTC m=+18.132447056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret") pod "global-pull-secret-syncer-bwfm4" (UID: "41dfa086-33fd-4a06-be28-9f8954c06cce") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:31.049139 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.048891    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs podName:268cd590-e93d-4e86-b011-3a28a0159167 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:39.048879767 +0000 UTC m=+18.132482064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs") pod "network-metrics-daemon-2h7hm" (UID: "268cd590-e93d-4e86-b011-3a28a0159167") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:31.149594 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:31.149553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:31.149789 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.149743    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:31.149789 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.149770    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:31.149789 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.149783    2558 projected.go:196] Error preparing data for projected volume kube-api-access-mscwx for pod openshift-network-diagnostics/network-check-target-5ngx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:31.150000 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.149860    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx podName:e813390b-c978-4422-81a9-d2f15e38f13b nodeName:}" failed. No retries permitted until 2026-07-11 03:48:39.149840942 +0000 UTC m=+18.233443251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mscwx" (UniqueName: "kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx") pod "network-check-target-5ngx7" (UID: "e813390b-c978-4422-81a9-d2f15e38f13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:31.533227 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:31.533195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:31.533420 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.533308    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:31.533678 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:31.533658    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:31.533781 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.533762    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:31.533851 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:31.533826    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:31.533916 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:31.533896    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:33.532013 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:33.531977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:33.532430 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:33.531977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:33.532430 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:33.532125    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:33.532430 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:33.532185    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:33.532430 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:33.531977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:33.532430 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:33.532326    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:35.532490 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:35.532449    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:35.532969 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:35.532449    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:35.532969 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:35.532586    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:35.532969 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:35.532672    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:35.532969 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:35.532449    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:35.532969 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:35.532762    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:37.532992 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:37.532955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:37.533454 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:37.532955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:37.533454 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:37.533096    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:37.533454 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:37.532955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:37.533454 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:37.533200    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:37.533454 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:37.533306    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:39.112719 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:39.112636    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:39.113232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:39.112756    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:39.113232 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.112830    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:39.113232 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.112875    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:39.113232 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.112911    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret podName:41dfa086-33fd-4a06-be28-9f8954c06cce nodeName:}" failed. No retries permitted until 2026-07-11 03:48:55.112889973 +0000 UTC m=+34.196492271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret") pod "global-pull-secret-syncer-bwfm4" (UID: "41dfa086-33fd-4a06-be28-9f8954c06cce") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:39.113232 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.112932    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs podName:268cd590-e93d-4e86-b011-3a28a0159167 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:55.112922162 +0000 UTC m=+34.196524459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs") pod "network-metrics-daemon-2h7hm" (UID: "268cd590-e93d-4e86-b011-3a28a0159167") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:39.214102 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:39.214063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:39.214302 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.214248    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:39.214302 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.214272    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:39.214302 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.214282    2558 projected.go:196] Error preparing data for projected volume kube-api-access-mscwx for pod openshift-network-diagnostics/network-check-target-5ngx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:39.214453 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.214340    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx podName:e813390b-c978-4422-81a9-d2f15e38f13b nodeName:}" failed. No retries permitted until 2026-07-11 03:48:55.214322083 +0000 UTC m=+34.297924375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mscwx" (UniqueName: "kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx") pod "network-check-target-5ngx7" (UID: "e813390b-c978-4422-81a9-d2f15e38f13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:39.532496 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:39.532400    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:39.532653 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.532536    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:39.532653 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:39.532571    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:39.532756 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.532665    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:39.532756 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:39.532689    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:39.532866 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:39.532764    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:41.532749 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:41.532711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:41.533229 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:41.532830    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:41.533229 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:41.532837    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:41.533229 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:41.532942    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:41.533229 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:41.532953    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:41.533229 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:41.533051    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:43.534534 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.534097    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:43.534534 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:43.534416    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:43.534534 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.534180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:43.534534 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:43.534495    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:43.534534 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.534097    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:43.535417 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:43.534573    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:43.703214 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.702843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"aa0b80f84e96b3eb86e723a80f0261cd0b234a80217570ea385298621f57be39"}
Jul 11 03:48:43.703214 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.703149    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"d24b5ef464112e686aa31918d26baeded7fc31726ef2e1d41d292406b346b9ab"}
Jul 11 03:48:43.703214 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.703206    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"e8ed75b11f02123f1ccc6982dea5f1b4818dd72f9af49ae17c1995243b6f068e"}
Jul 11 03:48:43.703367 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.703257    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"9d2a8865e9f01325465cfdb1de6dc85c3a4c448680142474dcc09b1c35494a31"}
Jul 11 03:48:43.704553 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.704497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8szj" event={"ID":"ff580988-4c06-4316-8934-f892f2338b83","Type":"ContainerStarted","Data":"130d8cf31ea1af5dcbe3561959658b489ae86758903f2bdd1dc57596a4ae8019"}
Jul 11 03:48:43.706240 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.706219    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-66bch" event={"ID":"c6b9e593-44c1-433a-ad4f-046bf0d4e69a","Type":"ContainerStarted","Data":"47bd1a6e84a8284a107b032290f4aa9002fef590bd5ecad38be69140bf14393b"}
Jul 11 03:48:43.707577 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.707551    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54" event={"ID":"bc1b9d1c-72dd-401c-9119-4c329c55dfb2","Type":"ContainerStarted","Data":"2f7be4897fe0d85d1656e6336a249f0adcab9a3c53b70b3a3fcc423df8e6ea21"}
Jul 11 03:48:43.709197 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.709118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ns77x" event={"ID":"45ab04ec-23fa-472b-8d12-4922b35c0107","Type":"ContainerStarted","Data":"865c5596ff56b4c2ab9b3a83715c8d096626314951d006aabe46735d9342b088"}
Jul 11 03:48:43.710896 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.710872    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d465f22-313f-42b6-b381-08efae2a0ecb" containerID="ce6440cce80fe610d8372f6d213820ea61cb6f71cf90499e47fb049b12ab631c" exitCode=0
Jul 11 03:48:43.710960 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.710924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerDied","Data":"ce6440cce80fe610d8372f6d213820ea61cb6f71cf90499e47fb049b12ab631c"}
Jul 11 03:48:43.712723 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.712690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hlxkm" event={"ID":"f826c89f-a3e2-4bae-a739-3210cc93e955","Type":"ContainerStarted","Data":"a19a25c9110f74cb14068fe846e65fa5a286445fd4ca10534ade57a4e4e2784e"}
Jul 11 03:48:43.714325 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.714300    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4w2w5" event={"ID":"2a767922-f3e8-4f33-b2ff-f3e317d27798","Type":"ContainerStarted","Data":"93539bbf2487b2b59ddfca59a04128543a4b7575421d9dfc69442ed88e30a263"}
Jul 11 03:48:43.722946 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.722902    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b8szj" podStartSLOduration=4.046405076 podStartE2EDuration="22.72288543s" totalImagesPullingTime="18.676480354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:43.722650103 +0000 UTC m=+22.806252524" watchObservedRunningTime="2026-07-11 03:48:43.72288543 +0000 UTC m=+22.806487743"
Jul 11 03:48:43.739686 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.739641    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4w2w5" podStartSLOduration=3.895707534 podStartE2EDuration="22.739627735s" totalImagesPullingTime="18.843920201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:43.739083775 +0000 UTC m=+22.822686088" watchObservedRunningTime="2026-07-11 03:48:43.739627735 +0000 UTC m=+22.823230046"
Jul 11 03:48:43.757658 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.757615    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ns77x" podStartSLOduration=4.083040801 podStartE2EDuration="22.75760031s" totalImagesPullingTime="18.674559509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:43.757440176 +0000 UTC m=+22.841042490" watchObservedRunningTime="2026-07-11 03:48:43.75760031 +0000 UTC m=+22.841202621"
Jul 11 03:48:43.795702 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.795665    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hlxkm" podStartSLOduration=8.866865565 podStartE2EDuration="22.795646372s" totalImagesPullingTime="13.928780807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:43.795602773 +0000 UTC m=+22.879205084" watchObservedRunningTime="2026-07-11 03:48:43.795646372 +0000 UTC m=+22.879248684"
Jul 11 03:48:43.932032 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.931955    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:43.932550 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.932532    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:43.946168 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:43.946127    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-66bch" podStartSLOduration=4.271288627 podStartE2EDuration="22.946110828s" totalImagesPullingTime="18.674822201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:43.810495405 +0000 UTC m=+22.894097718" watchObservedRunningTime="2026-07-11 03:48:43.946110828 +0000 UTC m=+23.029713133"
Jul 11 03:48:44.720067 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:44.719999    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"cf5c5ddcb4ae04133acb35b3c093246d6f0b36b834b318674fa611b2ce664f95"}
Jul 11 03:48:44.720697 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:44.720103    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"14ff0ca8935e575ee355c616f736b9a9d8bd10e0eaef2c920609058fddc06ac9"}
Jul 11 03:48:44.721054 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:44.720934    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:44.721826 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:44.721617    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hlxkm"
Jul 11 03:48:44.856337 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:44.856313    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 03:48:45.532114 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.532085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:45.532114 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.532100    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:45.532463 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.532085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:45.532463 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:45.532228    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:45.532463 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:45.532307    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:45.532463 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:45.532386    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:45.548397 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.548320    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T03:48:44.856331169Z","UUID":"ba37280b-8f83-4cd6-91f9-867962948e94","Handler":null,"Name":"","Endpoint":""}
Jul 11 03:48:45.549691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.549674    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 03:48:45.549816 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.549704    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 03:48:45.724351 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.724313    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fplq" event={"ID":"f73d5ad8-1841-416f-b68a-d0448ee74801","Type":"ContainerStarted","Data":"88a8804a8bf4a8034aff9b9a424cba48ed2d9dc196e5ead7778bb82177924921"}
Jul 11 03:48:45.728906 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.727707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54" event={"ID":"bc1b9d1c-72dd-401c-9119-4c329c55dfb2","Type":"ContainerStarted","Data":"ba50cff07bef7606005f7b8bcf2d52a3b89a28f1cc31f12c4404767fb85a2bc4"}
Jul 11 03:48:45.740622 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:45.740568    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5fplq" podStartSLOduration=23.740550547 podStartE2EDuration="23.740550547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-11 03:48:45.739723859 +0000 UTC m=+24.823326185" watchObservedRunningTime="2026-07-11 03:48:45.740550547 +0000 UTC m=+24.824152859"
Jul 11 03:48:46.734471 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:46.734433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"4bd512047285611ac2a4aa91211320bbfffc88e8ac3eeb254ff2617814e9ddd7"}
Jul 11 03:48:46.736899 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:46.736865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54" event={"ID":"bc1b9d1c-72dd-401c-9119-4c329c55dfb2","Type":"ContainerStarted","Data":"bed952a5f614c6fe6abc401300c6f484009c4a11d35dacf6a7b8b00966861d02"}
Jul 11 03:48:46.753236 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:46.753181    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25s54" podStartSLOduration=4.71451598 podStartE2EDuration="25.75316076s" totalImagesPullingTime="21.03864478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:46.752827325 +0000 UTC m=+25.836429672" watchObservedRunningTime="2026-07-11 03:48:46.75316076 +0000 UTC m=+25.836763074"
Jul 11 03:48:47.533104 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:47.532865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:47.533293 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:47.532883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:47.533293 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:47.533209    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:47.533293 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:47.532911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:47.533293 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:47.533279    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:47.533482 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:47.533378    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:48.747526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.747491    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" event={"ID":"0dbda28d-cbec-4d78-8a09-5448ec9174be","Type":"ContainerStarted","Data":"fc9c7b737a576e87c8f010cb76c371cabb33f29c420a010b8b8adba66458e25e"}
Jul 11 03:48:48.748410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.747676    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:48.748410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.747729    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:48.748410 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.747769    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:48.749549 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.749525    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d465f22-313f-42b6-b381-08efae2a0ecb" containerID="81520b47cecc471eb4c262ce4e9afd303aa1e821265e323efe119f906152bc63" exitCode=0
Jul 11 03:48:48.749667 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.749561    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerDied","Data":"81520b47cecc471eb4c262ce4e9afd303aa1e821265e323efe119f906152bc63"}
Jul 11 03:48:48.764029 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.764002    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:48.764151 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.764138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:48:48.771978 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:48.771933    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6" podStartSLOduration=9.050295184 podStartE2EDuration="27.771918892s" totalImagesPullingTime="18.721623708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:48.770119237 +0000 UTC m=+27.853721577" watchObservedRunningTime="2026-07-11 03:48:48.771918892 +0000 UTC m=+27.855521204"
Jul 11 03:48:49.532359 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:49.532277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:49.532359 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:49.532304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:49.532633 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:49.532410    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:49.532935 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:49.532760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:49.532935 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:49.532877    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:49.533097 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:49.532968    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:50.386860 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.386784    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5ngx7"]
Jul 11 03:48:50.387370 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.386966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:50.387370 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:50.387087    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:50.387641 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.387613    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bwfm4"]
Jul 11 03:48:50.387763 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.387721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:50.387834 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:50.387794    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:50.388234 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.388214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2h7hm"]
Jul 11 03:48:50.388309 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.388301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:50.388392 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:50.388376    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:50.755586 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.755504    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d465f22-313f-42b6-b381-08efae2a0ecb" containerID="18897eaf4c25726015d7b8c62f1ce6fe8f8288f415feb637663a0ebb5ef1e056" exitCode=0
Jul 11 03:48:50.755722 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:50.755582    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerDied","Data":"18897eaf4c25726015d7b8c62f1ce6fe8f8288f415feb637663a0ebb5ef1e056"}
Jul 11 03:48:52.532044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:52.531949    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:52.532044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:52.531974    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:52.532044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:52.531960    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:52.532481 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:52.532072    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:52.532481 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:52.532127    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:52.532481 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:52.532228    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:52.763629 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:52.763592    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d465f22-313f-42b6-b381-08efae2a0ecb" containerID="982eff467824737592523278288179cd191a07da2c5649b2dd490d3fed016aea" exitCode=0
Jul 11 03:48:52.763817 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:52.763674    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerDied","Data":"982eff467824737592523278288179cd191a07da2c5649b2dd490d3fed016aea"}
Jul 11 03:48:54.532955 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:54.532696    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:54.533388 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:54.532725    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:54.533388 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:54.533055    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ngx7" podUID="e813390b-c978-4422-81a9-d2f15e38f13b"
Jul 11 03:48:54.533388 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:54.532734    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:54.533388 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:54.533125    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwfm4" podUID="41dfa086-33fd-4a06-be28-9f8954c06cce"
Jul 11 03:48:54.533388 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:54.533205    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2h7hm" podUID="268cd590-e93d-4e86-b011-3a28a0159167"
Jul 11 03:48:55.126592 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:55.126552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:55.126820 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:55.126630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:55.126820 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.126743    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:55.126820 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.126787    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:55.126993 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.126820    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret podName:41dfa086-33fd-4a06-be28-9f8954c06cce nodeName:}" failed. No retries permitted until 2026-07-11 03:49:27.126787386 +0000 UTC m=+66.210389676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret") pod "global-pull-secret-syncer-bwfm4" (UID: "41dfa086-33fd-4a06-be28-9f8954c06cce") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:55.126993 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.126889    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs podName:268cd590-e93d-4e86-b011-3a28a0159167 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:27.126870907 +0000 UTC m=+66.210473201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs") pod "network-metrics-daemon-2h7hm" (UID: "268cd590-e93d-4e86-b011-3a28a0159167") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:55.227830 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:55.227782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:55.228022 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.227925    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:55.228022 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.227941    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:55.228022 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.227949    2558 projected.go:196] Error preparing data for projected volume kube-api-access-mscwx for pod openshift-network-diagnostics/network-check-target-5ngx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:55.228022 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:55.228005    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx podName:e813390b-c978-4422-81a9-d2f15e38f13b nodeName:}" failed. No retries permitted until 2026-07-11 03:49:27.22798756 +0000 UTC m=+66.311589850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mscwx" (UniqueName: "kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx") pod "network-check-target-5ngx7" (UID: "e813390b-c978-4422-81a9-d2f15e38f13b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:56.119104 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.119074    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-121.ec2.internal" event="NodeReady"
Jul 11 03:48:56.119567 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.119234    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 03:48:56.149925 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.149847    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"]
Jul 11 03:48:56.155864 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.155838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.155864 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.155851    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-764d4d74b9-f8qrn"]
Jul 11 03:48:56.158639 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.158615    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 11 03:48:56.158749 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.158684    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.158749 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.158716    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mknmr\""
Jul 11 03:48:56.158884 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.158624    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 11 03:48:56.158884 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.158871    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.159941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.159921    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"]
Jul 11 03:48:56.160338 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.160312    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.163298 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.163261    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 11 03:48:56.163976 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.163911    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 11 03:48:56.164180 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.164163    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"]
Jul 11 03:48:56.164297 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.164239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.165168 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.164648    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 11 03:48:56.165168 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.164662    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m95jx\""
Jul 11 03:48:56.168507 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.168332    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q484g\""
Jul 11 03:48:56.168507 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.168353    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.168825 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.168743    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"]
Jul 11 03:48:56.168986 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.168956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"
Jul 11 03:48:56.169228 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.169137    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 11 03:48:56.171017 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.170998    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.171405 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.171252    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 11 03:48:56.171405 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.170981    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 11 03:48:56.172763 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.172438    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h7b58\""
Jul 11 03:48:56.173334 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.173102    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.173334 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.173117    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.174383 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.174342    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xwrsz"]
Jul 11 03:48:56.174598 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.174576    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.177521 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.177428    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.177898 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.177763    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"]
Jul 11 03:48:56.178905 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.178753    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.179559 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.179509    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.182140 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.180432    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 11 03:48:56.182140 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.180764    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 11 03:48:56.185627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.183347    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.185627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.183455    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 11 03:48:56.185627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.183490    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-trkgj\""
Jul 11 03:48:56.185627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.183943    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.185627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.184240    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 11 03:48:56.185627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.177771    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h64vn\""
Jul 11 03:48:56.192290 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.192270    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 11 03:48:56.193026 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.193007    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-qxg2b"]
Jul 11 03:48:56.194235 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.194218    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:56.197438 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.197418    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.197993 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.197595    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 11 03:48:56.198230 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.197693    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gn6ts\""
Jul 11 03:48:56.198538 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.197834    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.210112 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.210089    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84d5b8478-qbnr4"]
Jul 11 03:48:56.212296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.212265    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.214100 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.214085    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"]
Jul 11 03:48:56.214242 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.214232    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"]
Jul 11 03:48:56.214358 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.214348    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xwrsz"]
Jul 11 03:48:56.214461 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.214452    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"]
Jul 11 03:48:56.214562 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.214554    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"]
Jul 11 03:48:56.214675 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.214666    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"]
Jul 11 03:48:56.217751 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.217728    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 11 03:48:56.218202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.218186    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.218537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.218522    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 11 03:48:56.218918 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.218903    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5r992\""
Jul 11 03:48:56.219221 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.219207    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.222768 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.222747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.223961 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.223883    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5bxmq"]
Jul 11 03:48:56.224065 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.223966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"
Jul 11 03:48:56.225910 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.225455    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 11 03:48:56.225910 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.225563    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 11 03:48:56.225910 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.225614    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.225910 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.225620    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.225910 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.225620    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-w6kk5\""
Jul 11 03:48:56.225910 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.225761    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 11 03:48:56.226247 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.225973    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 11 03:48:56.226617 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.226594    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.226698 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.226600    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.226990 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.226969    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zkkx2\""
Jul 11 03:48:56.227710 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.227690    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k2mc2"]
Jul 11 03:48:56.227870 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.227848    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.229610 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.229593    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 11 03:48:56.230923 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.230893    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 03:48:56.231006 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.230937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 03:48:56.231086 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231060    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzk9c\""
Jul 11 03:48:56.231783 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231763    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764d4d74b9-f8qrn"]
Jul 11 03:48:56.231870 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231818    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d5b8478-qbnr4"]
Jul 11 03:48:56.231870 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231847    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qxg2b"]
Jul 11 03:48:56.231870 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231866    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"]
Jul 11 03:48:56.232028 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231885    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"]
Jul 11 03:48:56.232028 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231903    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bxmq"]
Jul 11 03:48:56.232028 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.232028 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.231930    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2mc2"]
Jul 11 03:48:56.234460 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.234444    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 03:48:56.234625 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.234451    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 03:48:56.234694 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.234662    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mltsp\""
Jul 11 03:48:56.234771 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.234568    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 03:48:56.235291 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20520741-dec4-4e5e-a45a-b213d543aa38-ca-trust-extracted\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235377 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-registry-certificates\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235377 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235322    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-installation-pull-secrets\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235477 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzj8p\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-kube-api-access-wzj8p\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235477 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df1ba85f-731d-4460-8461-0e7a5b26e335-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.235477 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235603 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-image-registry-private-configuration\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235603 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-trusted-ca\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235661 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-bound-sa-token\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.235695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235663    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pxd9\" (UniqueName: \"kubernetes.io/projected/df1ba85f-731d-4460-8461-0e7a5b26e335-kube-api-access-8pxd9\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.235741 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.235711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df1ba85f-731d-4460-8461-0e7a5b26e335-config\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.336042 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdswp\" (UniqueName: \"kubernetes.io/projected/dc91ca83-83d5-4303-9683-06cf1e241801-kube-api-access-sdswp\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.336232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336058    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1eaf4d0-9a9f-40a2-bb69-2721825195fe-cert\") pod \"ingress-canary-k2mc2\" (UID: \"f1eaf4d0-9a9f-40a2-bb69-2721825195fe\") " pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.336232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-registry-certificates\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.336232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.336232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-stats-auth\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.336442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336233    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/158ad481-3766-49ff-a5c1-c447e652b27c-serving-cert\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.336442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bgq\" (UniqueName: \"kubernetes.io/projected/63e14f5a-2d39-48ca-8412-3ec42b0e63a4-kube-api-access-k4bgq\") pod \"network-check-source-869dcfcdcd-979wl\" (UID: \"63e14f5a-2d39-48ca-8412-3ec42b0e63a4\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"
Jul 11 03:48:56.336442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-installation-pull-secrets\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.336442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-default-certificate\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.336442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158ad481-3766-49ff-a5c1-c447e652b27c-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.336442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.336442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7865w\" (UniqueName: \"kubernetes.io/projected/bd03e2e5-4763-411f-8978-1c515b287ca0-kube-api-access-7865w\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.336790 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158ad481-3766-49ff-a5c1-c447e652b27c-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.336790 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336493    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:56.336790 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.336560    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 03:48:56.336790 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.336580    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764d4d74b9-f8qrn: secret "image-registry-tls" not found
Jul 11 03:48:56.336790 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df1ba85f-731d-4460-8461-0e7a5b26e335-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.336790 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.336657    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls podName:20520741-dec4-4e5e-a45a-b213d543aa38 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.836637651 +0000 UTC m=+35.920239945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls") pod "image-registry-764d4d74b9-f8qrn" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38") : secret "image-registry-tls" not found
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mlrn\" (UniqueName: \"kubernetes.io/projected/158ad481-3766-49ff-a5c1-c447e652b27c-kube-api-access-5mlrn\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-image-registry-private-configuration\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336886    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-bound-sa-token\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89xpb\" (UniqueName: \"kubernetes.io/projected/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-kube-api-access-89xpb\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc91ca83-83d5-4303-9683-06cf1e241801-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pxd9\" (UniqueName: \"kubernetes.io/projected/df1ba85f-731d-4460-8461-0e7a5b26e335-kube-api-access-8pxd9\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.336998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bh5r\" (UniqueName: \"kubernetes.io/projected/66a697bc-017b-486b-ad67-a6706843bb29-kube-api-access-4bh5r\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337023    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df1ba85f-731d-4460-8461-0e7a5b26e335-config\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc91ca83-83d5-4303-9683-06cf1e241801-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20520741-dec4-4e5e-a45a-b213d543aa38-ca-trust-extracted\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.337111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a697bc-017b-486b-ad67-a6706843bb29-tmp-dir\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwfp\" (UniqueName: \"kubernetes.io/projected/79f74409-e701-4519-92b7-dd97ee18425c-kube-api-access-mgwfp\") pod \"volume-data-source-validator-78495597f6-stg8r\" (UID: \"79f74409-e701-4519-92b7-dd97ee18425c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-trusted-ca\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgg8r\" (UniqueName: \"kubernetes.io/projected/35b014de-8987-44a1-b834-e8c8406e5270-kube-api-access-pgg8r\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzj8p\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-kube-api-access-wzj8p\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5hfb\" (UniqueName: \"kubernetes.io/projected/63371df1-7c7e-4dad-ae24-fb072ee4add9-kube-api-access-d5hfb\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63371df1-7c7e-4dad-ae24-fb072ee4add9-serving-cert\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158ad481-3766-49ff-a5c1-c447e652b27c-tmp\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63371df1-7c7e-4dad-ae24-fb072ee4add9-config\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/158ad481-3766-49ff-a5c1-c447e652b27c-snapshots\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9zsw\" (UniqueName: \"kubernetes.io/projected/f1eaf4d0-9a9f-40a2-bb69-2721825195fe-kube-api-access-v9zsw\") pod \"ingress-canary-k2mc2\" (UID: \"f1eaf4d0-9a9f-40a2-bb69-2721825195fe\") " pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337429    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.337681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63371df1-7c7e-4dad-ae24-fb072ee4add9-trusted-ca\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.338349 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.337900    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20520741-dec4-4e5e-a45a-b213d543aa38-ca-trust-extracted\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.338349 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.338079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-registry-certificates\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.338349 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.338097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df1ba85f-731d-4460-8461-0e7a5b26e335-config\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.338349 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.338172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66a697bc-017b-486b-ad67-a6706843bb29-config-volume\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.338841 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.338776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-trusted-ca\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.341130 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.341104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df1ba85f-731d-4460-8461-0e7a5b26e335-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.341264 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.341201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-image-registry-private-configuration\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.341264 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.341218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-installation-pull-secrets\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.345571 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.345550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-bound-sa-token\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.345697 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.345670    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzj8p\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-kube-api-access-wzj8p\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.346562 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.346539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pxd9\" (UniqueName: \"kubernetes.io/projected/df1ba85f-731d-4460-8461-0e7a5b26e335-kube-api-access-8pxd9\") pod \"service-ca-operator-7695fc6c8c-kd58z\" (UID: \"df1ba85f-731d-4460-8461-0e7a5b26e335\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.439473 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66a697bc-017b-486b-ad67-a6706843bb29-config-volume\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.439473 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdswp\" (UniqueName: \"kubernetes.io/projected/dc91ca83-83d5-4303-9683-06cf1e241801-kube-api-access-sdswp\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1eaf4d0-9a9f-40a2-bb69-2721825195fe-cert\") pod \"ingress-canary-k2mc2\" (UID: \"f1eaf4d0-9a9f-40a2-bb69-2721825195fe\") " pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-stats-auth\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/158ad481-3766-49ff-a5c1-c447e652b27c-serving-cert\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bgq\" (UniqueName: \"kubernetes.io/projected/63e14f5a-2d39-48ca-8412-3ec42b0e63a4-kube-api-access-k4bgq\") pod \"network-check-source-869dcfcdcd-979wl\" (UID: \"63e14f5a-2d39-48ca-8412-3ec42b0e63a4\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-default-certificate\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158ad481-3766-49ff-a5c1-c447e652b27c-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.439691 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439679    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7865w\" (UniqueName: \"kubernetes.io/projected/bd03e2e5-4763-411f-8978-1c515b287ca0-kube-api-access-7865w\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158ad481-3766-49ff-a5c1-c447e652b27c-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439771    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mlrn\" (UniqueName: \"kubernetes.io/projected/158ad481-3766-49ff-a5c1-c447e652b27c-kube-api-access-5mlrn\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89xpb\" (UniqueName: \"kubernetes.io/projected/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-kube-api-access-89xpb\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc91ca83-83d5-4303-9683-06cf1e241801-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bh5r\" (UniqueName: \"kubernetes.io/projected/66a697bc-017b-486b-ad67-a6706843bb29-kube-api-access-4bh5r\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.439921    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.439996    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls podName:8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.939977315 +0000 UTC m=+36.023579623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hkbf5" (UID: "8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351") : secret "cluster-monitoring-operator-tls" not found
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.440037    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 03:48:56.440071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66a697bc-017b-486b-ad67-a6706843bb29-config-volume\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.440086    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls podName:35b014de-8987-44a1-b834-e8c8406e5270 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.940072602 +0000 UTC m=+36.023674894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls") pod "cluster-samples-operator-65db858894-m76q5" (UID: "35b014de-8987-44a1-b834-e8c8406e5270") : secret "samples-operator-tls" not found
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.439930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc91ca83-83d5-4303-9683-06cf1e241801-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440182    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a697bc-017b-486b-ad67-a6706843bb29-tmp-dir\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwfp\" (UniqueName: \"kubernetes.io/projected/79f74409-e701-4519-92b7-dd97ee18425c-kube-api-access-mgwfp\") pod \"volume-data-source-validator-78495597f6-stg8r\" (UID: \"79f74409-e701-4519-92b7-dd97ee18425c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgg8r\" (UniqueName: \"kubernetes.io/projected/35b014de-8987-44a1-b834-e8c8406e5270-kube-api-access-pgg8r\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5hfb\" (UniqueName: \"kubernetes.io/projected/63371df1-7c7e-4dad-ae24-fb072ee4add9-kube-api-access-d5hfb\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63371df1-7c7e-4dad-ae24-fb072ee4add9-serving-cert\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158ad481-3766-49ff-a5c1-c447e652b27c-tmp\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63371df1-7c7e-4dad-ae24-fb072ee4add9-config\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/158ad481-3766-49ff-a5c1-c447e652b27c-snapshots\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9zsw\" (UniqueName: \"kubernetes.io/projected/f1eaf4d0-9a9f-40a2-bb69-2721825195fe-kube-api-access-v9zsw\") pod \"ingress-canary-k2mc2\" (UID: \"f1eaf4d0-9a9f-40a2-bb69-2721825195fe\") " pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.440585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63371df1-7c7e-4dad-ae24-fb072ee4add9-trusted-ca\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.441315 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158ad481-3766-49ff-a5c1-c447e652b27c-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.441315 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.440998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158ad481-3766-49ff-a5c1-c447e652b27c-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.441417 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.441324    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 03:48:56.441417 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.441380    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls podName:66a697bc-017b-486b-ad67-a6706843bb29 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.941363958 +0000 UTC m=+36.024966261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls") pod "dns-default-5bxmq" (UID: "66a697bc-017b-486b-ad67-a6706843bb29") : secret "dns-default-metrics-tls" not found
Jul 11 03:48:56.442044 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.441545    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 03:48:56.442044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.441553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc91ca83-83d5-4303-9683-06cf1e241801-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.442044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.441562    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63371df1-7c7e-4dad-ae24-fb072ee4add9-trusted-ca\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.442044 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.441595    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.941580841 +0000 UTC m=+36.025183131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : secret "router-metrics-certs-default" not found
Jul 11 03:48:56.442044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.441634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a697bc-017b-486b-ad67-a6706843bb29-tmp-dir\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.442044 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.441833    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.941818927 +0000 UTC m=+36.025421232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : configmap references non-existent config key: service-ca.crt
Jul 11 03:48:56.442044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.441861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/158ad481-3766-49ff-a5c1-c447e652b27c-tmp\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.442440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.442244    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63371df1-7c7e-4dad-ae24-fb072ee4add9-config\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.442440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.442248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/158ad481-3766-49ff-a5c1-c447e652b27c-snapshots\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.442706 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.442679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.443374 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.443324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc91ca83-83d5-4303-9683-06cf1e241801-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.443707 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.443685    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-default-certificate\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.444287 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.444261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/158ad481-3766-49ff-a5c1-c447e652b27c-serving-cert\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.444588 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.444545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63371df1-7c7e-4dad-ae24-fb072ee4add9-serving-cert\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.444720 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.444676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-stats-auth\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.444969 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.444949    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1eaf4d0-9a9f-40a2-bb69-2721825195fe-cert\") pod \"ingress-canary-k2mc2\" (UID: \"f1eaf4d0-9a9f-40a2-bb69-2721825195fe\") " pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.448996 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.448677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdswp\" (UniqueName: \"kubernetes.io/projected/dc91ca83-83d5-4303-9683-06cf1e241801-kube-api-access-sdswp\") pod \"kube-storage-version-migrator-operator-799cb7f958-wxggb\" (UID: \"dc91ca83-83d5-4303-9683-06cf1e241801\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.449211 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.449170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bgq\" (UniqueName: \"kubernetes.io/projected/63e14f5a-2d39-48ca-8412-3ec42b0e63a4-kube-api-access-k4bgq\") pod \"network-check-source-869dcfcdcd-979wl\" (UID: \"63e14f5a-2d39-48ca-8412-3ec42b0e63a4\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"
Jul 11 03:48:56.449306 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.449284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mlrn\" (UniqueName: \"kubernetes.io/projected/158ad481-3766-49ff-a5c1-c447e652b27c-kube-api-access-5mlrn\") pod \"insights-operator-68d9dd94cf-xwrsz\" (UID: \"158ad481-3766-49ff-a5c1-c447e652b27c\") " pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.451227 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.451182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5hfb\" (UniqueName: \"kubernetes.io/projected/63371df1-7c7e-4dad-ae24-fb072ee4add9-kube-api-access-d5hfb\") pod \"console-operator-7866497494-qxg2b\" (UID: \"63371df1-7c7e-4dad-ae24-fb072ee4add9\") " pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.451629 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.451609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7865w\" (UniqueName: \"kubernetes.io/projected/bd03e2e5-4763-411f-8978-1c515b287ca0-kube-api-access-7865w\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.451777 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.451756    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bh5r\" (UniqueName: \"kubernetes.io/projected/66a697bc-017b-486b-ad67-a6706843bb29-kube-api-access-4bh5r\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.452350 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.452309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwfp\" (UniqueName: \"kubernetes.io/projected/79f74409-e701-4519-92b7-dd97ee18425c-kube-api-access-mgwfp\") pod \"volume-data-source-validator-78495597f6-stg8r\" (UID: \"79f74409-e701-4519-92b7-dd97ee18425c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"
Jul 11 03:48:56.452970 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.452946    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89xpb\" (UniqueName: \"kubernetes.io/projected/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-kube-api-access-89xpb\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.453080 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.453061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9zsw\" (UniqueName: \"kubernetes.io/projected/f1eaf4d0-9a9f-40a2-bb69-2721825195fe-kube-api-access-v9zsw\") pod \"ingress-canary-k2mc2\" (UID: \"f1eaf4d0-9a9f-40a2-bb69-2721825195fe\") " pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.453690 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.453665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgg8r\" (UniqueName: \"kubernetes.io/projected/35b014de-8987-44a1-b834-e8c8406e5270-kube-api-access-pgg8r\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:56.470541 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.470514    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"
Jul 11 03:48:56.532440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.532400    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:48:56.532620 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.532400    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:48:56.532620 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.532412    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:48:56.532855 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.532797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"
Jul 11 03:48:56.535252 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.535226    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 03:48:56.535252 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.535238    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 03:48:56.535414 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.535230    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgqwh\""
Jul 11 03:48:56.535414 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.535259    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kfp2p\""
Jul 11 03:48:56.540456 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.540437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"
Jul 11 03:48:56.546884 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.546866    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz"
Jul 11 03:48:56.566676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.566654    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:48:56.578910 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.578886    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"
Jul 11 03:48:56.591890 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.591869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2mc2"
Jul 11 03:48:56.843522 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.843436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:56.843691 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.843608    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 03:48:56.843691 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.843631    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764d4d74b9-f8qrn: secret "image-registry-tls" not found
Jul 11 03:48:56.843788 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.843697    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls podName:20520741-dec4-4e5e-a45a-b213d543aa38 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.843674343 +0000 UTC m=+36.927276654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls") pod "image-registry-764d4d74b9-f8qrn" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38") : secret "image-registry-tls" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.944322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.944395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.944432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.944501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:56.944561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944564    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944615    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944660    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls podName:35b014de-8987-44a1-b834-e8c8406e5270 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.944638866 +0000 UTC m=+37.028241157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls") pod "cluster-samples-operator-65db858894-m76q5" (UID: "35b014de-8987-44a1-b834-e8c8406e5270") : secret "samples-operator-tls" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944678    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls podName:66a697bc-017b-486b-ad67-a6706843bb29 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.944668566 +0000 UTC m=+37.028270861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls") pod "dns-default-5bxmq" (UID: "66a697bc-017b-486b-ad67-a6706843bb29") : secret "dns-default-metrics-tls" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944700    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944740    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.944721711 +0000 UTC m=+37.028324017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : secret "router-metrics-certs-default" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944759    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.944748 +0000 UTC m=+37.028350293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : configmap references non-existent config key: service-ca.crt
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944818    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 03:48:56.945765 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:56.944853    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls podName:8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.944841601 +0000 UTC m=+37.028443894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hkbf5" (UID: "8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351") : secret "cluster-monitoring-operator-tls" not found
Jul 11 03:48:57.119021 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.118730    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qxg2b"]
Jul 11 03:48:57.121421 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.121354    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r"]
Jul 11 03:48:57.122796 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.122767    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2mc2"]
Jul 11 03:48:57.124130 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:57.124103    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63371df1_7c7e_4dad_ae24_fb072ee4add9.slice/crio-8e48129d6af1db2d3963eaa0d18db1caf93d064f9cd7e8f05e02ffa63103bf04 WatchSource:0}: Error finding container 8e48129d6af1db2d3963eaa0d18db1caf93d064f9cd7e8f05e02ffa63103bf04: Status 404 returned error can't find the container with id 8e48129d6af1db2d3963eaa0d18db1caf93d064f9cd7e8f05e02ffa63103bf04
Jul 11 03:48:57.124973 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:57.124917    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1eaf4d0_9a9f_40a2_bb69_2721825195fe.slice/crio-88477d7dc38536a2924b2b5be1331fec12879993818e38b7a831e31afceaf8e0 WatchSource:0}: Error finding container 88477d7dc38536a2924b2b5be1331fec12879993818e38b7a831e31afceaf8e0: Status 404 returned error can't find the container with id 88477d7dc38536a2924b2b5be1331fec12879993818e38b7a831e31afceaf8e0
Jul 11 03:48:57.126375 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:57.126330    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f74409_e701_4519_92b7_dd97ee18425c.slice/crio-e2ee13677df1508c2d16853bb8231f54d6c1507c0f74a912ec86b11a3f3248c0 WatchSource:0}: Error finding container e2ee13677df1508c2d16853bb8231f54d6c1507c0f74a912ec86b11a3f3248c0: Status 404 returned error can't find the container with id e2ee13677df1508c2d16853bb8231f54d6c1507c0f74a912ec86b11a3f3248c0
Jul 11 03:48:57.129787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.129255    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl"]
Jul 11 03:48:57.133748 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:57.133726    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e14f5a_2d39_48ca_8412_3ec42b0e63a4.slice/crio-0d66549be544a017e00515d311f34a21a5c770e1eab6a8be75e2c038896c3ac7 WatchSource:0}: Error finding container 0d66549be544a017e00515d311f34a21a5c770e1eab6a8be75e2c038896c3ac7: Status 404 returned error can't find the container with id 0d66549be544a017e00515d311f34a21a5c770e1eab6a8be75e2c038896c3ac7
Jul 11 03:48:57.141557 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.141535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb"]
Jul 11 03:48:57.145130 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:57.145091    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc91ca83_83d5_4303_9683_06cf1e241801.slice/crio-014eaebeee75aa03d4b6f66e3d1c59b42533f7aa0fe3038c07333b2508d7a2d6 WatchSource:0}: Error finding container 014eaebeee75aa03d4b6f66e3d1c59b42533f7aa0fe3038c07333b2508d7a2d6: Status 404 returned error can't find the container with id 014eaebeee75aa03d4b6f66e3d1c59b42533f7aa0fe3038c07333b2508d7a2d6
Jul 11 03:48:57.149193 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.148978    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xwrsz"]
Jul 11 03:48:57.149996 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.149894    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z"]
Jul 11 03:48:57.152878 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:57.152853    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158ad481_3766_49ff_a5c1_c447e652b27c.slice/crio-abe6157895db9e1aec6d568446ff7c89451f1691029e5bee2a6887329f1d0c4b WatchSource:0}: Error finding container abe6157895db9e1aec6d568446ff7c89451f1691029e5bee2a6887329f1d0c4b: Status 404 returned error can't find the container with id abe6157895db9e1aec6d568446ff7c89451f1691029e5bee2a6887329f1d0c4b
Jul 11 03:48:57.154066 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:48:57.154029    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1ba85f_731d_4460_8461_0e7a5b26e335.slice/crio-beb5a3c628d26a55ec47eceb37009eaec866a7a7259b4a36dc761506410e424d WatchSource:0}: Error finding container beb5a3c628d26a55ec47eceb37009eaec866a7a7259b4a36dc761506410e424d: Status 404 returned error can't find the container with id beb5a3c628d26a55ec47eceb37009eaec866a7a7259b4a36dc761506410e424d
Jul 11 03:48:57.778176 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.778090    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2mc2" event={"ID":"f1eaf4d0-9a9f-40a2-bb69-2721825195fe","Type":"ContainerStarted","Data":"88477d7dc38536a2924b2b5be1331fec12879993818e38b7a831e31afceaf8e0"}
Jul 11 03:48:57.780240 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.780197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z" event={"ID":"df1ba85f-731d-4460-8461-0e7a5b26e335","Type":"ContainerStarted","Data":"beb5a3c628d26a55ec47eceb37009eaec866a7a7259b4a36dc761506410e424d"}
Jul 11 03:48:57.782660 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.782579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r" event={"ID":"79f74409-e701-4519-92b7-dd97ee18425c","Type":"ContainerStarted","Data":"e2ee13677df1508c2d16853bb8231f54d6c1507c0f74a912ec86b11a3f3248c0"}
Jul 11 03:48:57.785797 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.785726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qxg2b" event={"ID":"63371df1-7c7e-4dad-ae24-fb072ee4add9","Type":"ContainerStarted","Data":"8e48129d6af1db2d3963eaa0d18db1caf93d064f9cd7e8f05e02ffa63103bf04"}
Jul 11 03:48:57.788519 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.788440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz" event={"ID":"158ad481-3766-49ff-a5c1-c447e652b27c","Type":"ContainerStarted","Data":"abe6157895db9e1aec6d568446ff7c89451f1691029e5bee2a6887329f1d0c4b"}
Jul 11 03:48:57.798907 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.797889    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d465f22-313f-42b6-b381-08efae2a0ecb" containerID="75febd521e131a90dc010449fab01f19355a3f2b825a874cb71557514ef7f25d" exitCode=0
Jul 11 03:48:57.798907 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.797985    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerDied","Data":"75febd521e131a90dc010449fab01f19355a3f2b825a874cb71557514ef7f25d"}
Jul 11 03:48:57.801091 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.801018    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl" event={"ID":"63e14f5a-2d39-48ca-8412-3ec42b0e63a4","Type":"ContainerStarted","Data":"0d66549be544a017e00515d311f34a21a5c770e1eab6a8be75e2c038896c3ac7"}
Jul 11 03:48:57.805194 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.805133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb" event={"ID":"dc91ca83-83d5-4303-9683-06cf1e241801","Type":"ContainerStarted","Data":"014eaebeee75aa03d4b6f66e3d1c59b42533f7aa0fe3038c07333b2508d7a2d6"}
Jul 11 03:48:57.852382 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.852345    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 03:48:57.852382 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.852382    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764d4d74b9-f8qrn: secret "image-registry-tls" not found
Jul 11 03:48:57.852598 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.852447    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls podName:20520741-dec4-4e5e-a45a-b213d543aa38 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:59.852426419 +0000 UTC m=+38.936028712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls") pod "image-registry-764d4d74b9-f8qrn" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38") : secret "image-registry-tls" not found
Jul 11 03:48:57.852917 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.852822    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.953531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.953583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.953659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.953753    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:57.953826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.954221    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.954280    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:59.954261262 +0000 UTC m=+39.037863561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : secret "router-metrics-certs-default" not found
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.954650    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.954713    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls podName:66a697bc-017b-486b-ad67-a6706843bb29 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:59.95469217 +0000 UTC m=+39.038294466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls") pod "dns-default-5bxmq" (UID: "66a697bc-017b-486b-ad67-a6706843bb29") : secret "dns-default-metrics-tls" not found
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.954990    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.955041    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:59.954986139 +0000 UTC m=+39.038588433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : configmap references non-existent config key: service-ca.crt
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.955064    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls podName:35b014de-8987-44a1-b834-e8c8406e5270 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:59.955053911 +0000 UTC m=+39.038656201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls") pod "cluster-samples-operator-65db858894-m76q5" (UID: "35b014de-8987-44a1-b834-e8c8406e5270") : secret "samples-operator-tls" not found
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.955079    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 03:48:57.956441 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:57.955116    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls podName:8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:59.955102608 +0000 UTC m=+39.038704901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hkbf5" (UID: "8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351") : secret "cluster-monitoring-operator-tls" not found
Jul 11 03:48:58.817723 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:58.817419    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d465f22-313f-42b6-b381-08efae2a0ecb" containerID="fc29878b848ed07d785e1dad5d94b0a188ef8fc45abacc11a231a7fa1be52f5e" exitCode=0
Jul 11 03:48:58.817723 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:58.817504    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerDied","Data":"fc29878b848ed07d785e1dad5d94b0a188ef8fc45abacc11a231a7fa1be52f5e"}
Jul 11 03:48:59.210243 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.208955    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-h988v"]
Jul 11 03:48:59.230624 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.229492    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-h988v"]
Jul 11 03:48:59.230624 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.229619    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:48:59.233698 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.232397    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 11 03:48:59.233698 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.232749    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bglcv\""
Jul 11 03:48:59.233698 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.232990    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 11 03:48:59.351359 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.351281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:48:59.369003 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.368972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:48:59.369175 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.369157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/10de6142-232a-4633-ac66-a3bd2a4fb382-nginx-conf\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:48:59.437407 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.437321    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:48:59.470463 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.470368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/10de6142-232a-4633-ac66-a3bd2a4fb382-nginx-conf\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:48:59.470463 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.470430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:48:59.471016 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.470694    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 03:48:59.471016 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.470768    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert podName:10de6142-232a-4633-ac66-a3bd2a4fb382 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:59.970745657 +0000 UTC m=+39.054347948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-h988v" (UID: "10de6142-232a-4633-ac66-a3bd2a4fb382") : secret "networking-console-plugin-cert" not found
Jul 11 03:48:59.471524 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.471501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/10de6142-232a-4633-ac66-a3bd2a4fb382-nginx-conf\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:48:59.538231 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.538039    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:48:59.873904 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.873865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:48:59.874446 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.874046    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 03:48:59.874446 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.874069    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764d4d74b9-f8qrn: secret "image-registry-tls" not found
Jul 11 03:48:59.874446 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.874137    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls podName:20520741-dec4-4e5e-a45a-b213d543aa38 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:03.874117957 +0000 UTC m=+42.957720250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls") pod "image-registry-764d4d74b9-f8qrn" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38") : secret "image-registry-tls" not found
Jul 11 03:48:59.974565 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.974523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:48:59.974736 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.974577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:59.974736 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.974612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:48:59.974736 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.974648    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 03:48:59.974736 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.974671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:48:59.974736 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.974714    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert podName:10de6142-232a-4633-ac66-a3bd2a4fb382 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:00.974694287 +0000 UTC m=+40.058296588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-h988v" (UID: "10de6142-232a-4633-ac66-a3bd2a4fb382") : secret "networking-console-plugin-cert" not found
Jul 11 03:48:59.975084 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.974762    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:03.97475198 +0000 UTC m=+43.058354272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : configmap references non-existent config key: service-ca.crt
Jul 11 03:48:59.975084 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.974782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:48:59.975084 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:48:59.974855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:48:59.975084 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.974970    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 03:48:59.975084 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.975010    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls podName:35b014de-8987-44a1-b834-e8c8406e5270 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:03.974997478 +0000 UTC m=+43.058599772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls") pod "cluster-samples-operator-65db858894-m76q5" (UID: "35b014de-8987-44a1-b834-e8c8406e5270") : secret "samples-operator-tls" not found
Jul 11 03:48:59.975084 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.975061    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 03:48:59.975084 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.975090    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:03.975081055 +0000 UTC m=+43.058683348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : secret "router-metrics-certs-default" not found
Jul 11 03:48:59.975439 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.975143    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 03:48:59.975439 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.975172    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls podName:66a697bc-017b-486b-ad67-a6706843bb29 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:03.975162266 +0000 UTC m=+43.058764563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls") pod "dns-default-5bxmq" (UID: "66a697bc-017b-486b-ad67-a6706843bb29") : secret "dns-default-metrics-tls" not found
Jul 11 03:48:59.975439 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.975216    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 03:48:59.975439 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:48:59.975257    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls podName:8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:03.975247222 +0000 UTC m=+43.058849523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hkbf5" (UID: "8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351") : secret "cluster-monitoring-operator-tls" not found
Jul 11 03:49:00.985153 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:00.985106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:49:00.985591 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:00.985283    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 03:49:00.985591 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:00.985366    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert podName:10de6142-232a-4633-ac66-a3bd2a4fb382 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:02.985346349 +0000 UTC m=+42.068948642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-h988v" (UID: "10de6142-232a-4633-ac66-a3bd2a4fb382") : secret "networking-console-plugin-cert" not found
Jul 11 03:49:02.150867 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:02.150599    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:02.203449 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:02.203415    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:03.004197 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:03.004157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:49:03.004395 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:03.004322    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 03:49:03.004471 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:03.004404    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert podName:10de6142-232a-4633-ac66-a3bd2a4fb382 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:07.004380773 +0000 UTC m=+46.087983062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-h988v" (UID: "10de6142-232a-4633-ac66-a3bd2a4fb382") : secret "networking-console-plugin-cert" not found
Jul 11 03:49:03.915032 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:03.914982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:49:03.915423 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:03.915175    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 03:49:03.915423 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:03.915199    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764d4d74b9-f8qrn: secret "image-registry-tls" not found
Jul 11 03:49:03.915423 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:03.915267    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls podName:20520741-dec4-4e5e-a45a-b213d543aa38 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:11.915245825 +0000 UTC m=+50.998848122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls") pod "image-registry-764d4d74b9-f8qrn" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38") : secret "image-registry-tls" not found
Jul 11 03:49:04.015474 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:04.015426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:04.015672 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:04.015511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:49:04.015672 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:04.015557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:49:04.015672 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015605    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:12.015583535 +0000 UTC m=+51.099185825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : configmap references non-existent config key: service-ca.crt
Jul 11 03:49:04.015672 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:04.015659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015680    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015720    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015747    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls podName:8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:12.015728921 +0000 UTC m=+51.099331216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hkbf5" (UID: "8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351") : secret "cluster-monitoring-operator-tls" not found
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015758    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:04.015689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015779    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls podName:35b014de-8987-44a1-b834-e8c8406e5270 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:12.015762538 +0000 UTC m=+51.099364833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls") pod "cluster-samples-operator-65db858894-m76q5" (UID: "35b014de-8987-44a1-b834-e8c8406e5270") : secret "samples-operator-tls" not found
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015817    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls podName:66a697bc-017b-486b-ad67-a6706843bb29 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:12.015789136 +0000 UTC m=+51.099391428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls") pod "dns-default-5bxmq" (UID: "66a697bc-017b-486b-ad67-a6706843bb29") : secret "dns-default-metrics-tls" not found
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015839    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 03:49:04.015905 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:04.015887    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:12.015874026 +0000 UTC m=+51.099476318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : secret "router-metrics-certs-default" not found
Jul 11 03:49:05.845585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.845545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" event={"ID":"7d465f22-313f-42b6-b381-08efae2a0ecb","Type":"ContainerStarted","Data":"b5d53b741a03b4c7e434dd2fe4b5ebf86e36c24e3f06f46658a6c9869dcd00a9"}
Jul 11 03:49:05.847099 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.847054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl" event={"ID":"63e14f5a-2d39-48ca-8412-3ec42b0e63a4","Type":"ContainerStarted","Data":"2e8be8e866a5ab04aaecc1da3c2c95041a27041f8c867a19a850d2f9cdea2972"}
Jul 11 03:49:05.848753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.848730    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb" event={"ID":"dc91ca83-83d5-4303-9683-06cf1e241801","Type":"ContainerStarted","Data":"3cbfad9b64ee7e5c9ac714ba06d31e9b24aa9dad7921ee72cc70798f93f6abd9"}
Jul 11 03:49:05.850593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.850570    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2mc2" event={"ID":"f1eaf4d0-9a9f-40a2-bb69-2721825195fe","Type":"ContainerStarted","Data":"61dba3d773603e51efaf6af3a92fc9ca7edd2d4f8a14112ca4fa14bbfcfcb7b1"}
Jul 11 03:49:05.852537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.852515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z" event={"ID":"df1ba85f-731d-4460-8461-0e7a5b26e335","Type":"ContainerStarted","Data":"7234a7fd81875860fc65598528ae8941c8b3b181f44a3a6f975dd83f1e49c205"}
Jul 11 03:49:05.854497 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.854470    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r" event={"ID":"79f74409-e701-4519-92b7-dd97ee18425c","Type":"ContainerStarted","Data":"ae952a10d2abd74b7754ad26fba0bf373072b4bf9369da7375901acab0b6a8e2"}
Jul 11 03:49:05.861386 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.861360    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/0.log"
Jul 11 03:49:05.861386 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.861407    2558 generic.go:356] "Generic (PLEG): container finished" podID="63371df1-7c7e-4dad-ae24-fb072ee4add9" containerID="592996a50401145f42ffb81709e5f8d01b5aa4acc4d7e7e362c1866c8336c7dd" exitCode=255
Jul 11 03:49:05.861663 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.861572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qxg2b" event={"ID":"63371df1-7c7e-4dad-ae24-fb072ee4add9","Type":"ContainerDied","Data":"592996a50401145f42ffb81709e5f8d01b5aa4acc4d7e7e362c1866c8336c7dd"}
Jul 11 03:49:05.861765 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.861748    2558 scope.go:117] "RemoveContainer" containerID="592996a50401145f42ffb81709e5f8d01b5aa4acc4d7e7e362c1866c8336c7dd"
Jul 11 03:49:05.863311 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.863288    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz" event={"ID":"158ad481-3766-49ff-a5c1-c447e652b27c","Type":"ContainerStarted","Data":"fba09d17e211d079990f21f44d02463dd7657b201c6da2a7c37db02341f39092"}
Jul 11 03:49:05.868433 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.868388    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zz5xh" podStartSLOduration=15.35772456 podStartE2EDuration="44.868373255s" totalImagesPullingTime="29.510648695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:05.866182795 +0000 UTC m=+44.949785107" watchObservedRunningTime="2026-07-11 03:49:05.868373255 +0000 UTC m=+44.951975566"
Jul 11 03:49:05.880772 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.880721    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-979wl" podStartSLOduration=28.191012744 podStartE2EDuration="35.880699818s" totalImagesPullingTime="7.689687074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:05.880674506 +0000 UTC m=+44.964276844" watchObservedRunningTime="2026-07-11 03:49:05.880699818 +0000 UTC m=+44.964302110"
Jul 11 03:49:05.916883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.916042    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z" podStartSLOduration=34.258949855 podStartE2EDuration="41.916021468s" totalImagesPullingTime="7.657071613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:05.896732395 +0000 UTC m=+44.980334710" watchObservedRunningTime="2026-07-11 03:49:05.916021468 +0000 UTC m=+44.999623782"
Jul 11 03:49:05.916883 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.916146    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-stg8r" podStartSLOduration=34.2967587 podStartE2EDuration="41.916138561s" totalImagesPullingTime="7.619379861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:05.915440032 +0000 UTC m=+44.999042346" watchObservedRunningTime="2026-07-11 03:49:05.916138561 +0000 UTC m=+44.999740874"
Jul 11 03:49:05.932433 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.932347    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb" podStartSLOduration=34.265621655 podStartE2EDuration="41.932327474s" totalImagesPullingTime="7.666705819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:05.931985779 +0000 UTC m=+45.015588095" watchObservedRunningTime="2026-07-11 03:49:05.932327474 +0000 UTC m=+45.015929786"
Jul 11 03:49:05.948630 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.948579    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz" podStartSLOduration=34.289985654 podStartE2EDuration="41.94856143s" totalImagesPullingTime="7.658575776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:05.94770216 +0000 UTC m=+45.031304475" watchObservedRunningTime="2026-07-11 03:49:05.94856143 +0000 UTC m=+45.032163741"
Jul 11 03:49:05.990087 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.989764    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k2mc2" podStartSLOduration=2.301513437 podStartE2EDuration="9.989747186s" totalImagesPullingTime="7.688233749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:05.988004732 +0000 UTC m=+45.071607068" watchObservedRunningTime="2026-07-11 03:49:05.989747186 +0000 UTC m=+45.073349499"
Jul 11 03:49:05.992648 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:05.992495    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:06.053558 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.053524    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"]
Jul 11 03:49:06.072601 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.072563    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:06.078613 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.078577    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"]
Jul 11 03:49:06.078734 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.078689    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"
Jul 11 03:49:06.082151 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.081967    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 11 03:49:06.082151 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.081982    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9m8kn\""
Jul 11 03:49:06.082354 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.082246    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 11 03:49:06.129637 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.129593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:06.230126 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.230088    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:06.239213 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.239177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxw9v\" (UniqueName: \"kubernetes.io/projected/84128f04-6c9b-4f78-baf5-73b8eb791ff2-kube-api-access-qxw9v\") pod \"migrator-7f59b54f6c-4h648\" (UID: \"84128f04-6c9b-4f78-baf5-73b8eb791ff2\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"
Jul 11 03:49:06.340914 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.340829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxw9v\" (UniqueName: \"kubernetes.io/projected/84128f04-6c9b-4f78-baf5-73b8eb791ff2-kube-api-access-qxw9v\") pod \"migrator-7f59b54f6c-4h648\" (UID: \"84128f04-6c9b-4f78-baf5-73b8eb791ff2\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"
Jul 11 03:49:06.357226 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.353441    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5xkrk"]
Jul 11 03:49:06.364952 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.364920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxw9v\" (UniqueName: \"kubernetes.io/projected/84128f04-6c9b-4f78-baf5-73b8eb791ff2-kube-api-access-qxw9v\") pod \"migrator-7f59b54f6c-4h648\" (UID: \"84128f04-6c9b-4f78-baf5-73b8eb791ff2\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"
Jul 11 03:49:06.369878 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.369672    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:06.370284 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.370238    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5xkrk"]
Jul 11 03:49:06.370425 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.370409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.374289 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.374259    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 03:49:06.374455 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.374297    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 03:49:06.374749 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.374321    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cjtvr\""
Jul 11 03:49:06.424370 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.424328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:06.425078 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.425055    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"
Jul 11 03:49:06.542418 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.542383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.542585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.542457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk8lm\" (UniqueName: \"kubernetes.io/projected/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-api-access-vk8lm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.542651 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.542591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-data-volume\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.542720 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.542648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.542773 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.542716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-crio-socket\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.567262 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.567230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:49:06.567414 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.567289    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:49:06.583742 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.583712    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648"]
Jul 11 03:49:06.586390 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:06.586363    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84128f04_6c9b_4f78_baf5_73b8eb791ff2.slice/crio-ccb8d333d9902606f0a621df2bd6a48880035058b7a231d3332a2f98f12223b8 WatchSource:0}: Error finding container ccb8d333d9902606f0a621df2bd6a48880035058b7a231d3332a2f98f12223b8: Status 404 returned error can't find the container with id ccb8d333d9902606f0a621df2bd6a48880035058b7a231d3332a2f98f12223b8
Jul 11 03:49:06.643993 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.643960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk8lm\" (UniqueName: \"kubernetes.io/projected/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-api-access-vk8lm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.644174 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.644059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-data-volume\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.644174 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.644096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.644174 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.644119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-crio-socket\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.644361 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:06.644245    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:06.644361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.644255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.644361 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:06.644303    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:07.144285639 +0000 UTC m=+46.227887928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:06.644361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.644350    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-crio-socket\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.644583 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:06.644391    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 03:49:06.644583 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:06.644496    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:07.144476895 +0000 UTC m=+46.228079199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : configmap "kube-rbac-proxy" not found
Jul 11 03:49:06.644583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.644526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-data-volume\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.652205 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.652182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk8lm\" (UniqueName: \"kubernetes.io/projected/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-api-access-vk8lm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:06.868914 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.868886    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 03:49:06.869343 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.869282    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/0.log"
Jul 11 03:49:06.869343 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.869311    2558 generic.go:356] "Generic (PLEG): container finished" podID="63371df1-7c7e-4dad-ae24-fb072ee4add9" containerID="18800a65ffb172070895aa03dd90e1c559a0845ec41ca5e1dfd9f5cd8553751b" exitCode=255
Jul 11 03:49:06.869435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.869379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qxg2b" event={"ID":"63371df1-7c7e-4dad-ae24-fb072ee4add9","Type":"ContainerDied","Data":"18800a65ffb172070895aa03dd90e1c559a0845ec41ca5e1dfd9f5cd8553751b"}
Jul 11 03:49:06.869435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.869418    2558 scope.go:117] "RemoveContainer" containerID="592996a50401145f42ffb81709e5f8d01b5aa4acc4d7e7e362c1866c8336c7dd"
Jul 11 03:49:06.869674 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.869649    2558 scope.go:117] "RemoveContainer" containerID="18800a65ffb172070895aa03dd90e1c559a0845ec41ca5e1dfd9f5cd8553751b"
Jul 11 03:49:06.869906 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:06.869879    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-qxg2b_openshift-console-operator(63371df1-7c7e-4dad-ae24-fb072ee4add9)\"" pod="openshift-console-operator/console-operator-7866497494-qxg2b" podUID="63371df1-7c7e-4dad-ae24-fb072ee4add9"
Jul 11 03:49:06.870829 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:06.870588    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648" event={"ID":"84128f04-6c9b-4f78-baf5-73b8eb791ff2","Type":"ContainerStarted","Data":"ccb8d333d9902606f0a621df2bd6a48880035058b7a231d3332a2f98f12223b8"}
Jul 11 03:49:07.047951 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.047912    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:49:07.048118 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:07.048063    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 03:49:07.048164 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:07.048125    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert podName:10de6142-232a-4633-ac66-a3bd2a4fb382 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:15.048110607 +0000 UTC m=+54.131712898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-h988v" (UID: "10de6142-232a-4633-ac66-a3bd2a4fb382") : secret "networking-console-plugin-cert" not found
Jul 11 03:49:07.079492 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.079457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:07.133651 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.133570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:07.148788 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.148756    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:07.148962 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.148841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:07.148962 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:07.148905    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:07.148962 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:07.148940    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 03:49:07.149060 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:07.148978    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:08.148960334 +0000 UTC m=+47.232562641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:07.149060 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:07.148994    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:08.148987928 +0000 UTC m=+47.232590218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : configmap "kube-rbac-proxy" not found
Jul 11 03:49:07.512690 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.512601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:07.562188 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.562149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:07.785484 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.785397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:07.878094 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.878067    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 03:49:07.878510 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.878446    2558 scope.go:117] "RemoveContainer" containerID="18800a65ffb172070895aa03dd90e1c559a0845ec41ca5e1dfd9f5cd8553751b"
Jul 11 03:49:07.878636 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:07.878609    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-qxg2b_openshift-console-operator(63371df1-7c7e-4dad-ae24-fb072ee4add9)\"" pod="openshift-console-operator/console-operator-7866497494-qxg2b" podUID="63371df1-7c7e-4dad-ae24-fb072ee4add9"
Jul 11 03:49:07.887154 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:07.887126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:08.157008 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:08.156972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:08.157182 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:08.157107    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 03:49:08.157182 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:08.157176    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:10.157159685 +0000 UTC m=+49.240761979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : configmap "kube-rbac-proxy" not found
Jul 11 03:49:08.157290 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:08.157198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:08.157345 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:08.157304    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:08.157345 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:08.157344    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:10.15733442 +0000 UTC m=+49.240936709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:08.349789 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:08.349757    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ns77x_45ab04ec-23fa-472b-8d12-4922b35c0107/dns-node-resolver/0.log"
Jul 11 03:49:08.886732 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:08.886697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648" event={"ID":"84128f04-6c9b-4f78-baf5-73b8eb791ff2","Type":"ContainerStarted","Data":"a4e5a5d3d07e78fce9801fab62ee46600221ece0517a4eada097535226f319f1"}
Jul 11 03:49:08.887249 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:08.886787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648" event={"ID":"84128f04-6c9b-4f78-baf5-73b8eb791ff2","Type":"ContainerStarted","Data":"e9490180b8b814ea405fde1c29bb75e4e911ab5de6553ea23747b96ec58f0a0a"}
Jul 11 03:49:08.901722 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:08.901674    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4h648" podStartSLOduration=1.030531851 podStartE2EDuration="2.901660646s" totalImagesPullingTime="1.871128795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:08.901182808 +0000 UTC m=+47.984785143" watchObservedRunningTime="2026-07-11 03:49:08.901660646 +0000 UTC m=+47.985262958"
Jul 11 03:49:08.967222 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:08.967172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:09.068144 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.068110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:09.149848 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.149744    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-66bch_c6b9e593-44c1-433a-ad4f-046bf0d4e69a/node-ca/0.log"
Jul 11 03:49:09.381849 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.381796    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-d954r"]
Jul 11 03:49:09.405817 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.405733    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-d954r"]
Jul 11 03:49:09.405941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.405868    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.408676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.408654    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 11 03:49:09.408794 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.408658    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 11 03:49:09.409941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.409923    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rm9cg\""
Jul 11 03:49:09.409997 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.409948    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 11 03:49:09.410179 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.410164    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 11 03:49:09.412929 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.412901    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:09.463943 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.463908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:09.468068 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.468046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-signing-cabundle\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.468162 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.468076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz264\" (UniqueName: \"kubernetes.io/projected/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-kube-api-access-lz264\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.468162 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.468139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-signing-key\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.568787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.568741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-signing-key\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.568970 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.568945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-signing-cabundle\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.569007 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.568976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz264\" (UniqueName: \"kubernetes.io/projected/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-kube-api-access-lz264\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.569530 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.569510    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-signing-cabundle\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.571198 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.571178    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-signing-key\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.576774 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.576748    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz264\" (UniqueName: \"kubernetes.io/projected/c90e9ab4-d326-44e9-a92a-daf6fc6b974e-kube-api-access-lz264\") pod \"service-ca-79f68b9f4f-d954r\" (UID: \"c90e9ab4-d326-44e9-a92a-daf6fc6b974e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.715451 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.715363    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-d954r"
Jul 11 03:49:09.735402 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.735366    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:09.836912 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.836877    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:09.864547 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.864525    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-d954r"]
Jul 11 03:49:09.866317 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:09.866293    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90e9ab4_d326_44e9_a92a_daf6fc6b974e.slice/crio-bf4594971d4088e892df53604c7700341bf16d24542f4f7d9970cf5f32c76113 WatchSource:0}: Error finding container bf4594971d4088e892df53604c7700341bf16d24542f4f7d9970cf5f32c76113: Status 404 returned error can't find the container with id bf4594971d4088e892df53604c7700341bf16d24542f4f7d9970cf5f32c76113
Jul 11 03:49:09.891345 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.891312    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-d954r" event={"ID":"c90e9ab4-d326-44e9-a92a-daf6fc6b974e","Type":"ContainerStarted","Data":"bf4594971d4088e892df53604c7700341bf16d24542f4f7d9970cf5f32c76113"}
Jul 11 03:49:09.950714 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:09.950683    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2mc2_f1eaf4d0-9a9f-40a2-bb69-2721825195fe/serve-healthcheck-canary/0.log"
Jul 11 03:49:10.150316 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.150286    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4h648_84128f04-6c9b-4f78-baf5-73b8eb791ff2/migrator/0.log"
Jul 11 03:49:10.175322 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.175273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:10.175507 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:10.175416    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:10.175507 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.175429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:10.175507 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:10.175476    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:14.175457651 +0000 UTC m=+53.259059941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:10.175507 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:10.175495    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 03:49:10.175718 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:10.175557    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:14.175543057 +0000 UTC m=+53.259145348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : configmap "kube-rbac-proxy" not found
Jul 11 03:49:10.221042 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.221007    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:10.350524 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.350497    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4h648_84128f04-6c9b-4f78-baf5-73b8eb791ff2/graceful-termination/0.log"
Jul 11 03:49:10.553496 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.553452    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wxggb_dc91ca83-83d5-4303-9683-06cf1e241801/kube-storage-version-migrator-operator/0.log"
Jul 11 03:49:10.896658 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.896624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-d954r" event={"ID":"c90e9ab4-d326-44e9-a92a-daf6fc6b974e","Type":"ContainerStarted","Data":"c28dcb0a2873ae29b71943aeea184be09fadc67bb3dee6f4cfc1e3551182a7c1"}
Jul 11 03:49:10.914169 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.914115    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-d954r" podStartSLOduration=1.9140979900000001 podStartE2EDuration="1.91409799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:10.913686422 +0000 UTC m=+49.997288767" watchObservedRunningTime="2026-07-11 03:49:10.91409799 +0000 UTC m=+49.997700341"
Jul 11 03:49:10.945752 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:10.945716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.048316 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.048282    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.145849 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.145796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.247186 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.247082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.309843 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.309789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.372701 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.372669    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.477997 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.477967    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.575473 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.575378    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.841987 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.841885    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:11.992700 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:11.992659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:49:11.993265 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:11.992926    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 03:49:11.993265 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:11.992952    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764d4d74b9-f8qrn: secret "image-registry-tls" not found
Jul 11 03:49:11.993265 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:11.993035    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls podName:20520741-dec4-4e5e-a45a-b213d543aa38 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:27.993013776 +0000 UTC m=+67.076616103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls") pod "image-registry-764d4d74b9-f8qrn" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38") : secret "image-registry-tls" not found
Jul 11 03:49:12.094153 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.094062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:49:12.094341 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.094154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:12.094341 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.094204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:49:12.094341 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.094257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:12.094341 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:12.094282    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 03:49:12.094341 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.094312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:49:12.094577 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:12.094358    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:28.094337908 +0000 UTC m=+67.177940219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : secret "router-metrics-certs-default" not found
Jul 11 03:49:12.094577 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:12.094392    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 03:49:12.094577 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:12.094413    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 03:49:12.094577 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:12.094460    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls podName:66a697bc-017b-486b-ad67-a6706843bb29 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:28.094442295 +0000 UTC m=+67.178044594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls") pod "dns-default-5bxmq" (UID: "66a697bc-017b-486b-ad67-a6706843bb29") : secret "dns-default-metrics-tls" not found
Jul 11 03:49:12.094577 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:12.094479    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle podName:bd03e2e5-4763-411f-8978-1c515b287ca0 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:28.094470493 +0000 UTC m=+67.178072788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle") pod "router-default-84d5b8478-qbnr4" (UID: "bd03e2e5-4763-411f-8978-1c515b287ca0") : configmap references non-existent config key: service-ca.crt
Jul 11 03:49:12.094577 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:12.094494    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls podName:8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:28.09448586 +0000 UTC m=+67.178088155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hkbf5" (UID: "8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351") : secret "cluster-monitoring-operator-tls" not found
Jul 11 03:49:12.096547 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.096527    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b014de-8987-44a1-b834-e8c8406e5270-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m76q5\" (UID: \"35b014de-8987-44a1-b834-e8c8406e5270\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:49:12.154359 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.154324    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"
Jul 11 03:49:12.292021 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.291982    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5"]
Jul 11 03:49:12.383040 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.383007    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:12.671225 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.671189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:12.848951 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.848912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:12.904427 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:12.904392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5" event={"ID":"35b014de-8987-44a1-b834-e8c8406e5270","Type":"ContainerStarted","Data":"c8f120da3473383ac28bd7b5e2f52530891638873d581c20a1867a9bbb06163e"}
Jul 11 03:49:13.240534 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:13.240500    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:13.438846 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:13.438790    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:13.641927 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:13.641894    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:13.846709 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:13.846665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:13.944408 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:13.944272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:14.215715 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:14.215628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:14.215715 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:14.215706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:14.215972 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:14.215829    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:14.215972 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:14.215912    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls podName:7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:22.215889652 +0000 UTC m=+61.299491947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xkrk" (UID: "7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4") : secret "insights-runtime-extractor-tls" not found
Jul 11 03:49:14.216366 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:14.216346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:14.833996 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:14.833948    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:14.913851 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:14.913819    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5" event={"ID":"35b014de-8987-44a1-b834-e8c8406e5270","Type":"ContainerStarted","Data":"29f3a41b0dc5a3f8100f8dcfc1432c557fd5e5583404efe50f38b6bfa2df5784"}
Jul 11 03:49:14.954349 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:14.954240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:15.125314 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.125282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:49:15.125479 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:15.125439    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 03:49:15.125520 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:15.125504    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert podName:10de6142-232a-4633-ac66-a3bd2a4fb382 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:31.125489093 +0000 UTC m=+70.209091386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-h988v" (UID: "10de6142-232a-4633-ac66-a3bd2a4fb382") : secret "networking-console-plugin-cert" not found
Jul 11 03:49:15.239665 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.239629    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:15.450820 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.450710    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:15.643781 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.643740    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:15.696310 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.696270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:15.841539 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.841446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:15.918500 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.918462    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5" event={"ID":"35b014de-8987-44a1-b834-e8c8406e5270","Type":"ContainerStarted","Data":"2d09222da21ea957460d4a98b00d51e03acd5eacf0a605c776f4563ae1e80866"}
Jul 11 03:49:15.935609 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:15.935551    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m76q5" podStartSLOduration=49.524736617 podStartE2EDuration="51.935536188s" totalImagesPullingTime="2.410799571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:15.933442112 +0000 UTC m=+55.017044456" watchObservedRunningTime="2026-07-11 03:49:15.935536188 +0000 UTC m=+55.019138499"
Jul 11 03:49:16.567318 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.567269    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:49:16.567487 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.567340    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:49:16.567699 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.567687    2558 scope.go:117] "RemoveContainer" containerID="18800a65ffb172070895aa03dd90e1c559a0845ec41ca5e1dfd9f5cd8553751b"
Jul 11 03:49:16.838790 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.838691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:16.923695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.923664    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 03:49:16.924180 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.923790    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qxg2b" event={"ID":"63371df1-7c7e-4dad-ae24-fb072ee4add9","Type":"ContainerStarted","Data":"909a70354f8b14167492623d3a85ebebc63223bfdeea8398202d1be57476f8ee"}
Jul 11 03:49:16.924250 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.924220    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:49:16.939914 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:16.939860    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-qxg2b" podStartSLOduration=44.25356782 podStartE2EDuration="51.939840869s" totalImagesPullingTime="7.686273049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:16.938915488 +0000 UTC m=+56.022517840" watchObservedRunningTime="2026-07-11 03:49:16.939840869 +0000 UTC m=+56.023443185"
Jul 11 03:49:17.002397 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.002361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.248917 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.248883    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.442296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.442250    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.454881 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.454847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-qxg2b"
Jul 11 03:49:17.543383 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.543285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.644536 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.644506    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.745133 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.745099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.800703 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.800615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.857281 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.857240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:17.958585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:17.958547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:18.102063 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:18.102024    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:18.207586 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:18.207547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:18.306343 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:18.306307    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:18.406252 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:18.406166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:18.503771 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:18.503730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.037609 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.037574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.138546 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.138507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.243346 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.243314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.342320 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.342235    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.440193 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.440156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.541574 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.541538    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.641636 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.641598    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.742352 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.742313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:19.842625 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:19.842588    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:20.766668 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:20.766639    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wrw6"
Jul 11 03:49:21.038403 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:21.038293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:21.237667 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:21.237632    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:21.441566 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:21.441535    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:21.638022 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:21.637989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:21.839438 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:21.839356    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:22.236756 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:22.236721    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:22.292300 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:22.292266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:22.294548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:22.294528    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xkrk\" (UID: \"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4\") " pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:22.585566 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:22.585483    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cjtvr\""
Jul 11 03:49:22.594136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:22.594114    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5xkrk"
Jul 11 03:49:22.717302 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:22.717279    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5xkrk"]
Jul 11 03:49:22.719901 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:22.719862    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8d624b_b5cf_46ad_95e0_dd0deaa45aa4.slice/crio-10ccc2c529ed52684ef6db86db2fc57e3a10d43a93e636121ed6523a7fb4daab WatchSource:0}: Error finding container 10ccc2c529ed52684ef6db86db2fc57e3a10d43a93e636121ed6523a7fb4daab: Status 404 returned error can't find the container with id 10ccc2c529ed52684ef6db86db2fc57e3a10d43a93e636121ed6523a7fb4daab
Jul 11 03:49:22.944533 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:22.944498    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xkrk" event={"ID":"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4","Type":"ContainerStarted","Data":"10ccc2c529ed52684ef6db86db2fc57e3a10d43a93e636121ed6523a7fb4daab"}
Jul 11 03:49:25.324780 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:25.324740    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:25.370389 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:25.370346    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:25.951551 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:25.951505    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:26.002232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:26.002195    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:26.961613 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:26.961571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xkrk" event={"ID":"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4","Type":"ContainerStarted","Data":"0c3a6787fe550aaa3f339c98dd8226a9cb2ab96033955987d2c9ce70254c80d3"}
Jul 11 03:49:27.138460 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.138436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:49:27.138593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.138502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:49:27.141188 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.141064    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 03:49:27.142124 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.142104    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 03:49:27.151181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.151155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41dfa086-33fd-4a06-be28-9f8954c06cce-original-pull-secret\") pod \"global-pull-secret-syncer-bwfm4\" (UID: \"41dfa086-33fd-4a06-be28-9f8954c06cce\") " pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:49:27.151278 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.151165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/268cd590-e93d-4e86-b011-3a28a0159167-metrics-certs\") pod \"network-metrics-daemon-2h7hm\" (UID: \"268cd590-e93d-4e86-b011-3a28a0159167\") " pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:49:27.239709 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.239616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:49:27.242295 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.242260    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscwx\" (UniqueName: \"kubernetes.io/projected/e813390b-c978-4422-81a9-d2f15e38f13b-kube-api-access-mscwx\") pod \"network-check-target-5ngx7\" (UID: \"e813390b-c978-4422-81a9-d2f15e38f13b\") " pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:49:27.444922 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.444888    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwfm4"
Jul 11 03:49:27.454487 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.454406    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgqwh\""
Jul 11 03:49:27.459454 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.459429    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kfp2p\""
Jul 11 03:49:27.462330 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.462306    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2h7hm"
Jul 11 03:49:27.468276 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.468253    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:49:27.593729 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.593233    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bwfm4"]
Jul 11 03:49:27.596952 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:27.596908    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41dfa086_33fd_4a06_be28_9f8954c06cce.slice/crio-823c977771cbb086789b141c772b91b87c4a2991aecc979c5ca796fbff5597a4 WatchSource:0}: Error finding container 823c977771cbb086789b141c772b91b87c4a2991aecc979c5ca796fbff5597a4: Status 404 returned error can't find the container with id 823c977771cbb086789b141c772b91b87c4a2991aecc979c5ca796fbff5597a4
Jul 11 03:49:27.614273 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.614238    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2h7hm"]
Jul 11 03:49:27.618204 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:27.618179    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268cd590_e93d_4e86_b011_3a28a0159167.slice/crio-24ec3eac779878c240511e48c4ac651b9f7020c9cc2dbe51632ff86a4c71db43 WatchSource:0}: Error finding container 24ec3eac779878c240511e48c4ac651b9f7020c9cc2dbe51632ff86a4c71db43: Status 404 returned error can't find the container with id 24ec3eac779878c240511e48c4ac651b9f7020c9cc2dbe51632ff86a4c71db43
Jul 11 03:49:27.638812 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.638778    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5ngx7"]
Jul 11 03:49:27.644308 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:27.644273    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode813390b_c978_4422_81a9_d2f15e38f13b.slice/crio-372ac7e4695f1eb0cf5fc60819fffada0ec8b72624d80dbe882fad56b60adc9a WatchSource:0}: Error finding container 372ac7e4695f1eb0cf5fc60819fffada0ec8b72624d80dbe882fad56b60adc9a: Status 404 returned error can't find the container with id 372ac7e4695f1eb0cf5fc60819fffada0ec8b72624d80dbe882fad56b60adc9a
Jul 11 03:49:27.675054 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.674992    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:27.970922 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.970879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bwfm4" event={"ID":"41dfa086-33fd-4a06-be28-9f8954c06cce","Type":"ContainerStarted","Data":"823c977771cbb086789b141c772b91b87c4a2991aecc979c5ca796fbff5597a4"}
Jul 11 03:49:27.972373 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.972339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2h7hm" event={"ID":"268cd590-e93d-4e86-b011-3a28a0159167","Type":"ContainerStarted","Data":"24ec3eac779878c240511e48c4ac651b9f7020c9cc2dbe51632ff86a4c71db43"}
Jul 11 03:49:27.974506 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.974478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xkrk" event={"ID":"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4","Type":"ContainerStarted","Data":"52b88b3464836307c40c1c288a9dd5c1b86c29f8ace328d40360fc13ca3df894"}
Jul 11 03:49:27.976122 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.976088    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5ngx7" event={"ID":"e813390b-c978-4422-81a9-d2f15e38f13b","Type":"ContainerStarted","Data":"17ac1ef7a0a69e411a3adbd51ea3b361979d1768de9867c1b0acfc90ab9f0735"}
Jul 11 03:49:27.976226 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.976185    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5ngx7" event={"ID":"e813390b-c978-4422-81a9-d2f15e38f13b","Type":"ContainerStarted","Data":"372ac7e4695f1eb0cf5fc60819fffada0ec8b72624d80dbe882fad56b60adc9a"}
Jul 11 03:49:27.976276 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.976252    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:49:27.991431 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:27.991383    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5ngx7" podStartSLOduration=65.991364554 podStartE2EDuration="1m5.991364554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:27.9900483 +0000 UTC m=+67.073650641" watchObservedRunningTime="2026-07-11 03:49:27.991364554 +0000 UTC m=+67.074966868"
Jul 11 03:49:28.047035 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.046989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:49:28.049639 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.049608    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"image-registry-764d4d74b9-f8qrn\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") " pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:49:28.148632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.148173    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:28.148632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.148253    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:49:28.148632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.148333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:28.148632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.148371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:49:28.149104 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.148988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd03e2e5-4763-411f-8978-1c515b287ca0-service-ca-bundle\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:28.151396 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.151366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd03e2e5-4763-411f-8978-1c515b287ca0-metrics-certs\") pod \"router-default-84d5b8478-qbnr4\" (UID: \"bd03e2e5-4763-411f-8978-1c515b287ca0\") " pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:28.151536 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.151396    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hkbf5\" (UID: \"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:49:28.152440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.152399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66a697bc-017b-486b-ad67-a6706843bb29-metrics-tls\") pod \"dns-default-5bxmq\" (UID: \"66a697bc-017b-486b-ad67-a6706843bb29\") " pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:49:28.293887 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.293784    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m95jx\""
Jul 11 03:49:28.302127 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.302090    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:49:28.314772 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.314741    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q484g\""
Jul 11 03:49:28.323075 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.323041    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"
Jul 11 03:49:28.375109 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.375033    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-w6kk5\""
Jul 11 03:49:28.382612 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.382504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:28.388676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.388480    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzk9c\""
Jul 11 03:49:28.396651 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.396583    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:49:28.517078 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.517048    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764d4d74b9-f8qrn"]
Jul 11 03:49:28.539065 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.537772    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5"]
Jul 11 03:49:28.541752 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.541667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:28.595599 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.595471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:28.609999 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.609938    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84d5b8478-qbnr4"]
Jul 11 03:49:28.629462 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.629392    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bxmq"]
Jul 11 03:49:28.874836 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:28.874753    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8229f1fc_b1fb_4cca_9a7c_a3c5bbee9351.slice/crio-81f2654471fce3ed1af965fcf0fe4604cb981bd67c5d2d94ac0ed10d36d06726 WatchSource:0}: Error finding container 81f2654471fce3ed1af965fcf0fe4604cb981bd67c5d2d94ac0ed10d36d06726: Status 404 returned error can't find the container with id 81f2654471fce3ed1af965fcf0fe4604cb981bd67c5d2d94ac0ed10d36d06726
Jul 11 03:49:28.875219 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:28.875183    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a697bc_017b_486b_ad67_a6706843bb29.slice/crio-b64d3b9846d08770d917253bdb015f7fa2041b41d34f0419ff89d6fab7278ca7 WatchSource:0}: Error finding container b64d3b9846d08770d917253bdb015f7fa2041b41d34f0419ff89d6fab7278ca7: Status 404 returned error can't find the container with id b64d3b9846d08770d917253bdb015f7fa2041b41d34f0419ff89d6fab7278ca7
Jul 11 03:49:28.875999 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:28.875940    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20520741_dec4_4e5e_a45a_b213d543aa38.slice/crio-0bec7f98a159e9a6fc88a538687cf132ff208564789c1942fcb04193c303f8a7 WatchSource:0}: Error finding container 0bec7f98a159e9a6fc88a538687cf132ff208564789c1942fcb04193c303f8a7: Status 404 returned error can't find the container with id 0bec7f98a159e9a6fc88a538687cf132ff208564789c1942fcb04193c303f8a7
Jul 11 03:49:28.877961 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:28.877396    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd03e2e5_4763_411f_8978_1c515b287ca0.slice/crio-41a644970a637791b7795b59d735578514a9dda29ec52b231cb7322588fd29fe WatchSource:0}: Error finding container 41a644970a637791b7795b59d735578514a9dda29ec52b231cb7322588fd29fe: Status 404 returned error can't find the container with id 41a644970a637791b7795b59d735578514a9dda29ec52b231cb7322588fd29fe
Jul 11 03:49:28.987785 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.987697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d5b8478-qbnr4" event={"ID":"bd03e2e5-4763-411f-8978-1c515b287ca0","Type":"ContainerStarted","Data":"db359b8ebea159a9606b20afaeac7b273833be5af5ae25008f3397d5eadb698e"}
Jul 11 03:49:28.987785 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.987769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84d5b8478-qbnr4" event={"ID":"bd03e2e5-4763-411f-8978-1c515b287ca0","Type":"ContainerStarted","Data":"41a644970a637791b7795b59d735578514a9dda29ec52b231cb7322588fd29fe"}
Jul 11 03:49:28.991155 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.991125    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bxmq" event={"ID":"66a697bc-017b-486b-ad67-a6706843bb29","Type":"ContainerStarted","Data":"b64d3b9846d08770d917253bdb015f7fa2041b41d34f0419ff89d6fab7278ca7"}
Jul 11 03:49:28.993438 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.993313    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5" event={"ID":"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351","Type":"ContainerStarted","Data":"81f2654471fce3ed1af965fcf0fe4604cb981bd67c5d2d94ac0ed10d36d06726"}
Jul 11 03:49:28.995913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.995452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn" event={"ID":"20520741-dec4-4e5e-a45a-b213d543aa38","Type":"ContainerStarted","Data":"7a871f3d9bce6d319e166d900c4064f7e7bedb3b006e26251c63bdc1a8e3353b"}
Jul 11 03:49:28.995913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.995492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn" event={"ID":"20520741-dec4-4e5e-a45a-b213d543aa38","Type":"ContainerStarted","Data":"0bec7f98a159e9a6fc88a538687cf132ff208564789c1942fcb04193c303f8a7"}
Jul 11 03:49:28.995913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:28.995674    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:49:29.016678 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:29.016618    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn" podStartSLOduration=67.016591685 podStartE2EDuration="1m7.016591685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:29.014305316 +0000 UTC m=+68.097907628" watchObservedRunningTime="2026-07-11 03:49:29.016591685 +0000 UTC m=+68.100193997"
Jul 11 03:49:30.020624 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:30.020573    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84d5b8478-qbnr4" podStartSLOduration=65.020557006 podStartE2EDuration="1m5.020557006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:30.018994607 +0000 UTC m=+69.102596925" watchObservedRunningTime="2026-07-11 03:49:30.020557006 +0000 UTC m=+69.104159317"
Jul 11 03:49:30.383409 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:30.383375    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:30.386205 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:30.386182    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:31.008675 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.008579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2h7hm" event={"ID":"268cd590-e93d-4e86-b011-3a28a0159167","Type":"ContainerStarted","Data":"e92d7a65760a7e19b00412ee9ed7b6fc3493c5c72d0364737fd71ec71c80d9a7"}
Jul 11 03:49:31.009068 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.009045    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:31.010475 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.010297    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84d5b8478-qbnr4"
Jul 11 03:49:31.101030 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.100996    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"]
Jul 11 03:49:31.120172 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.120137    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"]
Jul 11 03:49:31.120871 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.120845    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.124920 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.124218    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 11 03:49:31.124920 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.124739    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 11 03:49:31.125280 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.125256    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 11 03:49:31.125414 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.125395    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zhbn8\""
Jul 11 03:49:31.125516 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.125503    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 11 03:49:31.134352 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.134327    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"]
Jul 11 03:49:31.134610 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.134591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.149392 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.148453    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 11 03:49:31.151212 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.150041    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"]
Jul 11 03:49:31.151212 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.150077    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"]
Jul 11 03:49:31.151212 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.150191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.158686 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.157614    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 11 03:49:31.159772 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.159748    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 11 03:49:31.161933 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.161422    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:31.163147 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.163073    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 11 03:49:31.166482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.165775    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"]
Jul 11 03:49:31.174653 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.174631    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 11 03:49:31.187913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.187883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:49:31.188969 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.188949    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-4jmmb"]
Jul 11 03:49:31.192251 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.192227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10de6142-232a-4633-ac66-a3bd2a4fb382-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-h988v\" (UID: \"10de6142-232a-4633-ac66-a3bd2a4fb382\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:49:31.222334 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.222275    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4jmmb"]
Jul 11 03:49:31.222511 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.222429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4jmmb"
Jul 11 03:49:31.228175 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.227180    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 11 03:49:31.228175 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.227469    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 11 03:49:31.228175 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.227641    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s5256\""
Jul 11 03:49:31.248536 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.248505    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:31.289011 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.288918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-hub\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.289011 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.288970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-ca\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.289011 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289003    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxtcs\" (UniqueName: \"kubernetes.io/projected/4b0fc716-9240-4fd7-a53f-e0256a7c2d80-kube-api-access-mxtcs\") pod \"managed-serviceaccount-addon-agent-64458b95db-lts24\" (UID: \"4b0fc716-9240-4fd7-a53f-e0256a7c2d80\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.289303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.289303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbzc\" (UniqueName: \"kubernetes.io/projected/7a29ebf2-b57f-463d-9e93-431930072171-kube-api-access-qnbzc\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.289303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46b2722-a341-41c0-8f10-d0952aba4d10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.289303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqb8k\" (UniqueName: \"kubernetes.io/projected/e46b2722-a341-41c0-8f10-d0952aba4d10-kube-api-access-jqb8k\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.289303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a29ebf2-b57f-463d-9e93-431930072171-tmp\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.289572 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b0fc716-9240-4fd7-a53f-e0256a7c2d80-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64458b95db-lts24\" (UID: \"4b0fc716-9240-4fd7-a53f-e0256a7c2d80\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.289572 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a29ebf2-b57f-463d-9e93-431930072171-klusterlet-config\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.289572 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.289406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.347934 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.347872    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:31.352980 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.352953    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bglcv\""
Jul 11 03:49:31.361384 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.361320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v"
Jul 11 03:49:31.390270 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-hub\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.390425 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-ca\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.390425 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxtcs\" (UniqueName: \"kubernetes.io/projected/4b0fc716-9240-4fd7-a53f-e0256a7c2d80-kube-api-access-mxtcs\") pod \"managed-serviceaccount-addon-agent-64458b95db-lts24\" (UID: \"4b0fc716-9240-4fd7-a53f-e0256a7c2d80\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.390425 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.390425 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbzc\" (UniqueName: \"kubernetes.io/projected/7a29ebf2-b57f-463d-9e93-431930072171-kube-api-access-qnbzc\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.390425 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46b2722-a341-41c0-8f10-d0952aba4d10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.390425 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqb8k\" (UniqueName: \"kubernetes.io/projected/e46b2722-a341-41c0-8f10-d0952aba4d10-kube-api-access-jqb8k\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.392177 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpwj\" (UniqueName: \"kubernetes.io/projected/3778e0e3-05c3-466c-8369-ebbda25bf65a-kube-api-access-nxpwj\") pod \"downloads-68c9cbb497-4jmmb\" (UID: \"3778e0e3-05c3-466c-8369-ebbda25bf65a\") " pod="openshift-console/downloads-68c9cbb497-4jmmb"
Jul 11 03:49:31.392177 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a29ebf2-b57f-463d-9e93-431930072171-tmp\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.392177 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b0fc716-9240-4fd7-a53f-e0256a7c2d80-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64458b95db-lts24\" (UID: \"4b0fc716-9240-4fd7-a53f-e0256a7c2d80\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.392177 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a29ebf2-b57f-463d-9e93-431930072171-klusterlet-config\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.392177 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.390600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.392177 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.391864    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e46b2722-a341-41c0-8f10-d0952aba4d10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.392527 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.392508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a29ebf2-b57f-463d-9e93-431930072171-tmp\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.396328 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.396282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b0fc716-9240-4fd7-a53f-e0256a7c2d80-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64458b95db-lts24\" (UID: \"4b0fc716-9240-4fd7-a53f-e0256a7c2d80\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.397220 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.397169    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a29ebf2-b57f-463d-9e93-431930072171-klusterlet-config\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.397328 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.397274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.397696 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.397654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-ca\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.399261 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.399217    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-hub\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.399364 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.399298    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e46b2722-a341-41c0-8f10-d0952aba4d10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.403179 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.403132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbzc\" (UniqueName: \"kubernetes.io/projected/7a29ebf2-b57f-463d-9e93-431930072171-kube-api-access-qnbzc\") pod \"klusterlet-addon-workmgr-b4d88b9b-w8n7c\" (UID: \"7a29ebf2-b57f-463d-9e93-431930072171\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.404506 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.404453    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqb8k\" (UniqueName: \"kubernetes.io/projected/e46b2722-a341-41c0-8f10-d0952aba4d10-kube-api-access-jqb8k\") pod \"cluster-proxy-proxy-agent-748f745c54-xvb2c\" (UID: \"e46b2722-a341-41c0-8f10-d0952aba4d10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.405148 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.405127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxtcs\" (UniqueName: \"kubernetes.io/projected/4b0fc716-9240-4fd7-a53f-e0256a7c2d80-kube-api-access-mxtcs\") pod \"managed-serviceaccount-addon-agent-64458b95db-lts24\" (UID: \"4b0fc716-9240-4fd7-a53f-e0256a7c2d80\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.449758 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.449723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:31.452193 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.452163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"
Jul 11 03:49:31.482109 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.482083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:31.492250 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.491870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpwj\" (UniqueName: \"kubernetes.io/projected/3778e0e3-05c3-466c-8369-ebbda25bf65a-kube-api-access-nxpwj\") pod \"downloads-68c9cbb497-4jmmb\" (UID: \"3778e0e3-05c3-466c-8369-ebbda25bf65a\") " pod="openshift-console/downloads-68c9cbb497-4jmmb"
Jul 11 03:49:31.504746 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.504721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"
Jul 11 03:49:31.506760 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.506709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpwj\" (UniqueName: \"kubernetes.io/projected/3778e0e3-05c3-466c-8369-ebbda25bf65a-kube-api-access-nxpwj\") pod \"downloads-68c9cbb497-4jmmb\" (UID: \"3778e0e3-05c3-466c-8369-ebbda25bf65a\") " pod="openshift-console/downloads-68c9cbb497-4jmmb"
Jul 11 03:49:31.547608 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.547237    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4jmmb"
Jul 11 03:49:31.548329 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:31.548302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:33.941963 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.941927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:33.945045 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.945014    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58df968c69-l8xk9"]
Jul 11 03:49:33.967267 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.967228    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58df968c69-l8xk9"]
Jul 11 03:49:33.967440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.967348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:33.970231 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.970194    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 11 03:49:33.970231 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.970203    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 11 03:49:33.970448 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.970289    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 11 03:49:33.970448 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.970295    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 11 03:49:33.970448 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.970195    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 11 03:49:33.971424 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:33.971388    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g7cdl\""
Jul 11 03:49:34.000180 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.000151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:34.115579 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.115555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-serving-cert\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.115676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.115596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-config\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.115676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.115641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-oauth-config\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.115751 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.115681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th45x\" (UniqueName: \"kubernetes.io/projected/6311fecb-46c0-44d6-936a-81f87a69b2ef-kube-api-access-th45x\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.115751 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.115739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-service-ca\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.115832 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.115774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-oauth-serving-cert\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.216853 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.216745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-config\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.216853 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.216793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-oauth-config\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.216853 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.216829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th45x\" (UniqueName: \"kubernetes.io/projected/6311fecb-46c0-44d6-936a-81f87a69b2ef-kube-api-access-th45x\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.217128 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.216864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-service-ca\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.217128 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.217022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-oauth-serving-cert\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.217128 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.217078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-serving-cert\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.217526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.217503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-service-ca\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.217526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.217510    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-config\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.217747 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.217726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-oauth-serving-cert\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.219255 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.219235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-oauth-config\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.219378 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.219341    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-serving-cert\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.224953 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.224930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th45x\" (UniqueName: \"kubernetes.io/projected/6311fecb-46c0-44d6-936a-81f87a69b2ef-kube-api-access-th45x\") pod \"console-58df968c69-l8xk9\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") " pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.276957 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.276921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:34.644398 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.639674    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4jmmb"]
Jul 11 03:49:34.644918 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.644861    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c"]
Jul 11 03:49:34.683246 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.683201    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-h988v"]
Jul 11 03:49:34.724200 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.724168    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24"]
Jul 11 03:49:34.727533 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:34.727467    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b0fc716_9240_4fd7_a53f_e0256a7c2d80.slice/crio-7c372e2fff23d86f96553379979f1a7e7a6e3abd0a446dc46d52c33d18cc501b WatchSource:0}: Error finding container 7c372e2fff23d86f96553379979f1a7e7a6e3abd0a446dc46d52c33d18cc501b: Status 404 returned error can't find the container with id 7c372e2fff23d86f96553379979f1a7e7a6e3abd0a446dc46d52c33d18cc501b
Jul 11 03:49:34.736524 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.736422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58df968c69-l8xk9"]
Jul 11 03:49:34.740902 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:34.740863    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6311fecb_46c0_44d6_936a_81f87a69b2ef.slice/crio-5579604bf6a8c5e65d3b5907dc87925ebb613bf338620192b58d27b17f0b0a6e WatchSource:0}: Error finding container 5579604bf6a8c5e65d3b5907dc87925ebb613bf338620192b58d27b17f0b0a6e: Status 404 returned error can't find the container with id 5579604bf6a8c5e65d3b5907dc87925ebb613bf338620192b58d27b17f0b0a6e
Jul 11 03:49:34.754595 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.754521    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"]
Jul 11 03:49:34.758201 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:34.758163    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a29ebf2_b57f_463d_9e93_431930072171.slice/crio-63d6f3de6147f2e1221550065aa1c45b306c355829ae250c7ca451a6978463fb WatchSource:0}: Error finding container 63d6f3de6147f2e1221550065aa1c45b306c355829ae250c7ca451a6978463fb: Status 404 returned error can't find the container with id 63d6f3de6147f2e1221550065aa1c45b306c355829ae250c7ca451a6978463fb
Jul 11 03:49:34.949649 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:34.949620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:35.025099 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.025007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v" event={"ID":"10de6142-232a-4633-ac66-a3bd2a4fb382","Type":"ContainerStarted","Data":"c49fbd9c8fab663fe7cfaf97f58270c674969e2a805ccc5d5e08a659b3738018"}
Jul 11 03:49:35.026965 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.026935    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2h7hm" event={"ID":"268cd590-e93d-4e86-b011-3a28a0159167","Type":"ContainerStarted","Data":"e2cefab2cd484c47194d58dc932f01cca4f0975f7800286830858854011600c0"}
Jul 11 03:49:35.029055 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.029024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xkrk" event={"ID":"7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4","Type":"ContainerStarted","Data":"390727d37c05ed2c451e977a98a08dea914c1f1723927346e66eee4c2f0430da"}
Jul 11 03:49:35.030230 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.030207    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c" event={"ID":"7a29ebf2-b57f-463d-9e93-431930072171","Type":"ContainerStarted","Data":"63d6f3de6147f2e1221550065aa1c45b306c355829ae250c7ca451a6978463fb"}
Jul 11 03:49:35.031322 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.031296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c" event={"ID":"e46b2722-a341-41c0-8f10-d0952aba4d10","Type":"ContainerStarted","Data":"4e61feb1d7b5cbd2e4298859c74db79124874623d16937f2f0b5c9b3c6ce2a27"}
Jul 11 03:49:35.032848 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.032825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bwfm4" event={"ID":"41dfa086-33fd-4a06-be28-9f8954c06cce","Type":"ContainerStarted","Data":"72df9ca536bd034ec84fd3f4a7a6b31efda6ae082a317a065f9c89e13d36a1c7"}
Jul 11 03:49:35.034843 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.034818    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bxmq" event={"ID":"66a697bc-017b-486b-ad67-a6706843bb29","Type":"ContainerStarted","Data":"5c52cde0395b0586462062d459baaaab8c599ff779c5282209e650159c774812"}
Jul 11 03:49:35.035006 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.034941    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:49:35.035239 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.035221    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bxmq" event={"ID":"66a697bc-017b-486b-ad67-a6706843bb29","Type":"ContainerStarted","Data":"5bb7266bf52a6ecc4cdb023277498f6365304f56a5b29e998958e98a52f7146e"}
Jul 11 03:49:35.036676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.036655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5" event={"ID":"8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351","Type":"ContainerStarted","Data":"172c4196584013efd42b33dd7b90b15fb6486c9733ca3decc9f5938cdff04aee"}
Jul 11 03:49:35.037982 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.037961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24" event={"ID":"4b0fc716-9240-4fd7-a53f-e0256a7c2d80","Type":"ContainerStarted","Data":"7c372e2fff23d86f96553379979f1a7e7a6e3abd0a446dc46d52c33d18cc501b"}
Jul 11 03:49:35.039191 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.039168    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58df968c69-l8xk9" event={"ID":"6311fecb-46c0-44d6-936a-81f87a69b2ef","Type":"ContainerStarted","Data":"5579604bf6a8c5e65d3b5907dc87925ebb613bf338620192b58d27b17f0b0a6e"}
Jul 11 03:49:35.040290 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.040269    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4jmmb" event={"ID":"3778e0e3-05c3-466c-8369-ebbda25bf65a","Type":"ContainerStarted","Data":"ba3810967b09423114dac9de6be3fd79b8fcaf70ae1fc7473d66248fb9bf08f0"}
Jul 11 03:49:35.042365 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.042327    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2h7hm" podStartSLOduration=71.111172226 podStartE2EDuration="1m14.042314341s" totalImagesPullingTime="2.931142115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:35.041097749 +0000 UTC m=+74.124700092" watchObservedRunningTime="2026-07-11 03:49:35.042314341 +0000 UTC m=+74.125916652"
Jul 11 03:49:35.045229 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.045207    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:35.057089 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.057032    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hkbf5" podStartSLOduration=65.574002142 podStartE2EDuration="1m11.05701232s" totalImagesPullingTime="5.483010178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:35.055545669 +0000 UTC m=+74.139147997" watchObservedRunningTime="2026-07-11 03:49:35.05701232 +0000 UTC m=+74.140614633"
Jul 11 03:49:35.074594 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.074535    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5xkrk" podStartSLOduration=17.636749695 podStartE2EDuration="29.07451051s" totalImagesPullingTime="11.437760815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:49:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:35.072701262 +0000 UTC m=+74.156303613" watchObservedRunningTime="2026-07-11 03:49:35.07451051 +0000 UTC m=+74.158112822"
Jul 11 03:49:35.092462 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.092414    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bwfm4" podStartSLOduration=66.342681745 podStartE2EDuration="1m13.092397757s" totalImagesPullingTime="6.749716012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:35.092064351 +0000 UTC m=+74.175666658" watchObservedRunningTime="2026-07-11 03:49:35.092397757 +0000 UTC m=+74.176000066"
Jul 11 03:49:35.113304 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.113244    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5bxmq" podStartSLOduration=33.632455667 podStartE2EDuration="39.113221923s" totalImagesPullingTime="5.480766256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:35.112589338 +0000 UTC m=+74.196191669" watchObservedRunningTime="2026-07-11 03:49:35.113221923 +0000 UTC m=+74.196824236"
Jul 11 03:49:35.117443 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.117407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:35.123207 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.123180    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"]
Jul 11 03:49:35.136986 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.136948    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"]
Jul 11 03:49:35.137156 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.137101    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"
Jul 11 03:49:35.140627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.140597    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 11 03:49:35.141076 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.140638    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-psqtz\""
Jul 11 03:49:35.177778 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.177739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:35.227953 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.227904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01c3ca1c-26fa-4718-8ded-3170653a3c9d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fwdbf\" (UID: \"01c3ca1c-26fa-4718-8ded-3170653a3c9d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"
Jul 11 03:49:35.232144 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.232113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:35.328907 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.328779    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01c3ca1c-26fa-4718-8ded-3170653a3c9d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fwdbf\" (UID: \"01c3ca1c-26fa-4718-8ded-3170653a3c9d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"
Jul 11 03:49:35.331939 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.331909    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/01c3ca1c-26fa-4718-8ded-3170653a3c9d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fwdbf\" (UID: \"01c3ca1c-26fa-4718-8ded-3170653a3c9d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"
Jul 11 03:49:35.448923 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.448620    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"
Jul 11 03:49:35.551120 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.551002    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76494b57b5-j8lct"]
Jul 11 03:49:35.567470 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.567436    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76494b57b5-j8lct"]
Jul 11 03:49:35.567651 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.567582    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.575638 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.575557    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:35.581528 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.580178    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 11 03:49:35.658267 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.657858    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"]
Jul 11 03:49:35.667672 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:35.667624    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c3ca1c_26fa_4718_8ded_3170653a3c9d.slice/crio-122dc5ab38173c5c80e5ebcf26c422b4625b109e8fb805d74f693b4a3e55aa51 WatchSource:0}: Error finding container 122dc5ab38173c5c80e5ebcf26c422b4625b109e8fb805d74f693b4a3e55aa51: Status 404 returned error can't find the container with id 122dc5ab38173c5c80e5ebcf26c422b4625b109e8fb805d74f693b4a3e55aa51
Jul 11 03:49:35.733927 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.733886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-service-ca\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.734146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.733942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4j9z\" (UniqueName: \"kubernetes.io/projected/753bbff0-accb-431b-8a99-8fac2c2f0cd4-kube-api-access-d4j9z\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.734146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.733995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-serving-cert\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.734146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.734034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-oauth-serving-cert\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.734146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.734075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-trusted-ca-bundle\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.734146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.734108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-config\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.734146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.734145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-oauth-config\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.835418 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.835324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-service-ca\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.835418 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.835385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4j9z\" (UniqueName: \"kubernetes.io/projected/753bbff0-accb-431b-8a99-8fac2c2f0cd4-kube-api-access-d4j9z\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.835704 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.835433    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-serving-cert\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.835704 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.835466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-oauth-serving-cert\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.835704 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.835507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-trusted-ca-bundle\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.835704 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.835551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-config\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.835704 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.835589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-oauth-config\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.837149 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.837069    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-service-ca\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.837149 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.837140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-config\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.838416 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.838388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-oauth-serving-cert\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.838788 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.838767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-trusted-ca-bundle\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.847375 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.847327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-serving-cert\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.855581 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.855528    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-oauth-config\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.857481 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.857432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4j9z\" (UniqueName: \"kubernetes.io/projected/753bbff0-accb-431b-8a99-8fac2c2f0cd4-kube-api-access-d4j9z\") pod \"console-76494b57b5-j8lct\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") " pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:35.887295 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:35.886974    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:36.076611 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:36.074741    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf" event={"ID":"01c3ca1c-26fa-4718-8ded-3170653a3c9d","Type":"ContainerStarted","Data":"122dc5ab38173c5c80e5ebcf26c422b4625b109e8fb805d74f693b4a3e55aa51"}
Jul 11 03:49:36.102303 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:36.099521    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76494b57b5-j8lct"]
Jul 11 03:49:36.303350 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:36.303142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:36.360442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:36.360309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:37.165226 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:37.165187    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753bbff0_accb_431b_8a99_8fac2c2f0cd4.slice/crio-d07f49227f688c0ec1767ef924a15c09af8afc0e77ddeb285e078831cbb757f5 WatchSource:0}: Error finding container d07f49227f688c0ec1767ef924a15c09af8afc0e77ddeb285e078831cbb757f5: Status 404 returned error can't find the container with id d07f49227f688c0ec1767ef924a15c09af8afc0e77ddeb285e078831cbb757f5
Jul 11 03:49:37.345597 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:37.345488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:37.445483 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:37.445401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:37.775501 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:37.775347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:38.104459 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:38.104348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76494b57b5-j8lct" event={"ID":"753bbff0-accb-431b-8a99-8fac2c2f0cd4","Type":"ContainerStarted","Data":"d07f49227f688c0ec1767ef924a15c09af8afc0e77ddeb285e078831cbb757f5"}
Jul 11 03:49:40.135980 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:40.135741    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:40.235940 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:40.235884    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:40.950139 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:40.950084    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:40.999998 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:40.999954    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:42.398174 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:42.398137    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:42.449015 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:42.448932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:44.139609 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:44.139568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v" event={"ID":"10de6142-232a-4633-ac66-a3bd2a4fb382","Type":"ContainerStarted","Data":"214d0d9d3921a5f197ea9a8071eb398c081354c5f2d8e40d5bfdeb5d03634bc1"}
Jul 11 03:49:44.155588 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:44.154822    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-h988v" podStartSLOduration=42.507095555 podStartE2EDuration="45.154789388s" totalImagesPullingTime="2.647693833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:44.153699127 +0000 UTC m=+83.237301439" watchObservedRunningTime="2026-07-11 03:49:44.154789388 +0000 UTC m=+83.238391701"
Jul 11 03:49:44.278703 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:44.278670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:44.380286 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:44.380201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:45.077440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.077406    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5bxmq"
Jul 11 03:49:45.148005 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.147964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24" event={"ID":"4b0fc716-9240-4fd7-a53f-e0256a7c2d80","Type":"ContainerStarted","Data":"8e13900f30faa6cc0536f5bfe05db447ef6f3020affea6065a72893e77ce27d4"}
Jul 11 03:49:45.149626 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.149600    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76494b57b5-j8lct" event={"ID":"753bbff0-accb-431b-8a99-8fac2c2f0cd4","Type":"ContainerStarted","Data":"5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce"}
Jul 11 03:49:45.151196 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.151172    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58df968c69-l8xk9" event={"ID":"6311fecb-46c0-44d6-936a-81f87a69b2ef","Type":"ContainerStarted","Data":"d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09"}
Jul 11 03:49:45.152593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.152573    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c" event={"ID":"7a29ebf2-b57f-463d-9e93-431930072171","Type":"ContainerStarted","Data":"72d38e0a2830970b5b499ae9630426be5ef61e9382a28f5e672b2d2434f3cebb"}
Jul 11 03:49:45.152737 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.152720    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:45.154551 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.154535    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c"
Jul 11 03:49:45.154656 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.154595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c" event={"ID":"e46b2722-a341-41c0-8f10-d0952aba4d10","Type":"ContainerStarted","Data":"852b040d03981a29e79d5e6aebab85bd402a1a444ceaab743b60c20758d1968d"}
Jul 11 03:49:45.154656 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.154616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c" event={"ID":"e46b2722-a341-41c0-8f10-d0952aba4d10","Type":"ContainerStarted","Data":"a6271b174f857375ad7acf0dd74241d7c5cafd927eb8f356a6f2c845775a081a"}
Jul 11 03:49:45.154774 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.154640    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c" event={"ID":"e46b2722-a341-41c0-8f10-d0952aba4d10","Type":"ContainerStarted","Data":"042192f04d937d728190af595988f15cac35012e38a1295ca2216c741bde0a42"}
Jul 11 03:49:45.156058 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.156033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf" event={"ID":"01c3ca1c-26fa-4718-8ded-3170653a3c9d","Type":"ContainerStarted","Data":"d6d5da81cd3f7929c2c686ab1eec464e40012c6b7833e0fc0664fec98c188dce"}
Jul 11 03:49:45.156146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.156076    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"
Jul 11 03:49:45.161081 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.161043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf"
Jul 11 03:49:45.162122 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.162087    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64458b95db-lts24" podStartSLOduration=4.737200679 podStartE2EDuration="14.162068902s" totalImagesPullingTime="9.424868223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:45.162024618 +0000 UTC m=+84.245626965" watchObservedRunningTime="2026-07-11 03:49:45.162068902 +0000 UTC m=+84.245671217"
Jul 11 03:49:45.178387 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.178333    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4d88b9b-w8n7c" podStartSLOduration=4.761587374 podStartE2EDuration="14.178313549s" totalImagesPullingTime="9.416726175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:45.177585176 +0000 UTC m=+84.261187514" watchObservedRunningTime="2026-07-11 03:49:45.178313549 +0000 UTC m=+84.261915863"
Jul 11 03:49:45.195097 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.195047    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58df968c69-l8xk9" podStartSLOduration=2.771657913 podStartE2EDuration="12.195031334s" totalImagesPullingTime="9.423373421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:45.193976389 +0000 UTC m=+84.277578703" watchObservedRunningTime="2026-07-11 03:49:45.195031334 +0000 UTC m=+84.278633714"
Jul 11 03:49:45.212180 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.212103    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76494b57b5-j8lct" podStartSLOduration=3.187303076 podStartE2EDuration="10.212035247s" totalImagesPullingTime="7.024732171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:45.211224528 +0000 UTC m=+84.294826860" watchObservedRunningTime="2026-07-11 03:49:45.212035247 +0000 UTC m=+84.295637644"
Jul 11 03:49:45.230775 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.230726    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-748f745c54-xvb2c" podStartSLOduration=4.723073 podStartE2EDuration="14.230710203s" totalImagesPullingTime="9.507637203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:45.229283264 +0000 UTC m=+84.312885607" watchObservedRunningTime="2026-07-11 03:49:45.230710203 +0000 UTC m=+84.314312514"
Jul 11 03:49:45.244773 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.244718    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fwdbf" podStartSLOduration=1.769935824 podStartE2EDuration="10.244697165s" totalImagesPullingTime="8.474761341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:45.242409523 +0000 UTC m=+84.326011836" watchObservedRunningTime="2026-07-11 03:49:45.244697165 +0000 UTC m=+84.328299474"
Jul 11 03:49:45.888297 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.888258    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:45.888479 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.888328    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:49:45.890024 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.889989    2558 patch_prober.go:28] interesting pod/console-76494b57b5-j8lct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused" start-of-body=
Jul 11 03:49:45.890167 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:45.890051    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76494b57b5-j8lct" podUID="753bbff0-accb-431b-8a99-8fac2c2f0cd4" containerName="console" probeResult="failure" output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 11 03:49:46.148256 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:46.148149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:46.210627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:46.210589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:46.262449 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:46.262411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:47.537875 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:47.537831    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:47.583818 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:47.583775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:47.793183 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:47.793097    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:47.849313 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:47.849270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:47.934508 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:47.934476    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:48.035630 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:48.035586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:48.135726 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:48.135684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:48.235792 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:48.235749    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:48.307497 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:48.307464    2558 patch_prober.go:28] interesting pod/image-registry-764d4d74b9-f8qrn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 11 03:49:48.307698 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:48.307525    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn" podUID="20520741-dec4-4e5e-a45a-b213d543aa38" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 03:49:50.006001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.005970    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:49:50.286644 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.286534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:50.383584 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.383549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:50.500936 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.500793    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:50.558693 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.558605    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wlm7d"]
Jul 11 03:49:50.582389 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.582215    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:50.648777 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.648715    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:50.673536 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.673501    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.676454 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.676270    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 03:49:50.676454 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.676300    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 03:49:50.676454 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.676316    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 03:49:50.676736 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.676668    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zqpj\""
Jul 11 03:49:50.677434 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.677407    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 03:49:50.746777 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.746706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778603    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-root\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-sys\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-wtmp\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778757    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-tls\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8k2\" (UniqueName: \"kubernetes.io/projected/cde59669-ea2e-40c5-a093-45695df35d0b-kube-api-access-zm8k2\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-textfile\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.779136 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.778933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cde59669-ea2e-40c5-a093-45695df35d0b-metrics-client-ca\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.849486 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.849451    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.879861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-root\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.879926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.879965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-sys\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.879989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-wtmp\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.879997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-root\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-tls\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8k2\" (UniqueName: \"kubernetes.io/projected/cde59669-ea2e-40c5-a093-45695df35d0b-kube-api-access-zm8k2\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-textfile\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.880593 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cde59669-ea2e-40c5-a093-45695df35d0b-metrics-client-ca\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.881243 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.881243 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cde59669-ea2e-40c5-a093-45695df35d0b-metrics-client-ca\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.881243 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.880902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-sys\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.881243 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:50.881164    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 11 03:49:50.881443 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:49:50.881254    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-tls podName:cde59669-ea2e-40c5-a093-45695df35d0b nodeName:}" failed. No retries permitted until 2026-07-11 03:49:51.381233227 +0000 UTC m=+90.464835523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-tls") pod "node-exporter-wlm7d" (UID: "cde59669-ea2e-40c5-a093-45695df35d0b") : secret "node-exporter-tls" not found
Jul 11 03:49:50.881501 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.881453    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-textfile\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.881595 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.881576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-wtmp\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.886372 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.886346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.889829 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.889767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8k2\" (UniqueName: \"kubernetes.io/projected/cde59669-ea2e-40c5-a093-45695df35d0b-kube-api-access-zm8k2\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:50.951100 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:50.951056    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:51.214146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.214043    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:51.327044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.327010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:51.385406 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.385368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-tls\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:51.388164 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.388135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cde59669-ea2e-40c5-a093-45695df35d0b-node-exporter-tls\") pod \"node-exporter-wlm7d\" (UID: \"cde59669-ea2e-40c5-a093-45695df35d0b\") " pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:51.425502 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.425465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:51.525406 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.525270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:51.587614 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.587363    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wlm7d"
Jul 11 03:49:51.588703 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.588667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:51.729490 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:51.729445    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:53.197161 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:53.197105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:53.301612 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:53.301576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:53.397201 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:53.397163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:53.497668 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:53.497579    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:53.565994 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:53.565934    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:53.945928 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:53.945869    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:54.046796 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:54.046755    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:54.187307 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:54.187265    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:54.277824 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:54.277733    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:54.278259 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:54.277835    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:54.283250 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:54.283221    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:54.288282 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:54.288252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:54.763993 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:49:54.763951    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde59669_ea2e_40c5_a093_45695df35d0b.slice/crio-ec7ad21e84ada24a89c7cf6dfed769b8f8290fdfc94bbbb251dc799b2947c8d4 WatchSource:0}: Error finding container ec7ad21e84ada24a89c7cf6dfed769b8f8290fdfc94bbbb251dc799b2947c8d4: Status 404 returned error can't find the container with id ec7ad21e84ada24a89c7cf6dfed769b8f8290fdfc94bbbb251dc799b2947c8d4
Jul 11 03:49:54.953195 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:54.953153    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:55.006632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:55.006593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:55.220475 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:55.220430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlm7d" event={"ID":"cde59669-ea2e-40c5-a093-45695df35d0b","Type":"ContainerStarted","Data":"ec7ad21e84ada24a89c7cf6dfed769b8f8290fdfc94bbbb251dc799b2947c8d4"}
Jul 11 03:49:55.225140 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:55.225105    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:49:55.528617 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:55.528516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:55.635603 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:55.635481    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:55.699617 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:55.699588    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76494b57b5-j8lct"]
Jul 11 03:49:56.228055 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:56.227984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4jmmb" event={"ID":"3778e0e3-05c3-466c-8369-ebbda25bf65a","Type":"ContainerStarted","Data":"8d68277198d739237849eb054123c64d30c547f52009dcaa81d7870800d3a77a"}
Jul 11 03:49:56.245884 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:56.245829    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-4jmmb" podStartSLOduration=4.748948816 podStartE2EDuration="25.245792281s" totalImagesPullingTime="20.496843465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:56.243795802 +0000 UTC m=+95.327398118" watchObservedRunningTime="2026-07-11 03:49:56.245792281 +0000 UTC m=+95.329394594"
Jul 11 03:49:56.762157 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:56.762117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:57.236449 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:57.236411    2558 generic.go:356] "Generic (PLEG): container finished" podID="cde59669-ea2e-40c5-a093-45695df35d0b" containerID="41b49b50f7ce8350982d6fd3fb09e3e5b431a9a983ab613dd3d25c6c231e2dbd" exitCode=0
Jul 11 03:49:57.236652 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:57.236503    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlm7d" event={"ID":"cde59669-ea2e-40c5-a093-45695df35d0b","Type":"ContainerDied","Data":"41b49b50f7ce8350982d6fd3fb09e3e5b431a9a983ab613dd3d25c6c231e2dbd"}
Jul 11 03:49:57.237050 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:57.237024    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-4jmmb"
Jul 11 03:49:57.247766 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:57.247730    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-4jmmb"
Jul 11 03:49:58.182550 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.182511    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-764d4d74b9-f8qrn"]
Jul 11 03:49:58.187284 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.187249    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:58.246286 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.245736    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlm7d" event={"ID":"cde59669-ea2e-40c5-a093-45695df35d0b","Type":"ContainerStarted","Data":"a1ff7c05d8834d7a1e3a503c7a25125e68027ee2ccc81bd69cbf5781fb2288ae"}
Jul 11 03:49:58.246286 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.245830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wlm7d" event={"ID":"cde59669-ea2e-40c5-a093-45695df35d0b","Type":"ContainerStarted","Data":"386b7fc6320a591d5b6f3176d1daf7e0155bd6199b8de3a0c0dfdfb842d9ffad"}
Jul 11 03:49:58.251765 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.251736    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:58.267462 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.263776    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wlm7d" podStartSLOduration=6.667854288 podStartE2EDuration="8.263756089s" totalImagesPullingTime="1.482391661s" totalInitContainerRuntime="113.51014ms" isStatefulPod=true podCreationTimestamp="2026-07-11 03:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:58.262197007 +0000 UTC m=+97.345799320" watchObservedRunningTime="2026-07-11 03:49:58.263756089 +0000 UTC m=+97.347358402"
Jul 11 03:49:58.308268 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.308223    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:58.409424 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.409369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:58.460181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:58.460099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:59.005569 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:59.005534    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5ngx7"
Jul 11 03:49:59.327796 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:59.327713    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:59.430295 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:59.430255    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:49:59.483858 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:49:59.483765    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:01.099429 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:01.099399    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:01.151067 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:01.151031    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:03.201969 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:03.201902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:03.306500 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:03.306458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:03.917941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:03.917899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:04.518174 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:04.518140    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:04.618968 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:04.618939    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:07.250755 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:07.250725    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:07.303669 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:07.303623    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:10.950326 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:10.950290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:11.003319 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:11.003282    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:11.308441 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:11.308360    2558 generic.go:356] "Generic (PLEG): container finished" podID="158ad481-3766-49ff-a5c1-c447e652b27c" containerID="fba09d17e211d079990f21f44d02463dd7657b201c6da2a7c37db02341f39092" exitCode=0
Jul 11 03:50:11.308594 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:11.308435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz" event={"ID":"158ad481-3766-49ff-a5c1-c447e652b27c","Type":"ContainerDied","Data":"fba09d17e211d079990f21f44d02463dd7657b201c6da2a7c37db02341f39092"}
Jul 11 03:50:11.308881 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:11.308865    2558 scope.go:117] "RemoveContainer" containerID="fba09d17e211d079990f21f44d02463dd7657b201c6da2a7c37db02341f39092"
Jul 11 03:50:12.314761 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:12.314726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xwrsz" event={"ID":"158ad481-3766-49ff-a5c1-c447e652b27c","Type":"ContainerStarted","Data":"b14634ca3ddf0057270abd4ea0523ad74aedb8ee2bc244481e10e8036a06c252"}
Jul 11 03:50:13.933583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:13.933544    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58df968c69-l8xk9"]
Jul 11 03:50:14.025236 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:14.025198    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:14.123426 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:14.123390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:14.171202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:14.171166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:20.724684 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:20.724644    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76494b57b5-j8lct" podUID="753bbff0-accb-431b-8a99-8fac2c2f0cd4" containerName="console" containerID="cri-o://5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce" gracePeriod=15
Jul 11 03:50:21.029386 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.029347    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:50:21.174079 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.173976    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-serving-cert\") pod \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") "
Jul 11 03:50:21.174079 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174019    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-config\") pod \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") "
Jul 11 03:50:21.174079 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174069    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-oauth-serving-cert\") pod \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") "
Jul 11 03:50:21.174356 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174174    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-oauth-config\") pod \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") "
Jul 11 03:50:21.174356 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174219    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4j9z\" (UniqueName: \"kubernetes.io/projected/753bbff0-accb-431b-8a99-8fac2c2f0cd4-kube-api-access-d4j9z\") pod \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") "
Jul 11 03:50:21.174356 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174262    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-service-ca\") pod \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") "
Jul 11 03:50:21.174356 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174286    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-trusted-ca-bundle\") pod \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\" (UID: \"753bbff0-accb-431b-8a99-8fac2c2f0cd4\") "
Jul 11 03:50:21.174561 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174497    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "753bbff0-accb-431b-8a99-8fac2c2f0cd4" (UID: "753bbff0-accb-431b-8a99-8fac2c2f0cd4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:21.174694 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174619    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-oauth-serving-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:21.174694 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174650    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-config" (OuterVolumeSpecName: "console-config") pod "753bbff0-accb-431b-8a99-8fac2c2f0cd4" (UID: "753bbff0-accb-431b-8a99-8fac2c2f0cd4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:21.174694 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174655    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-service-ca" (OuterVolumeSpecName: "service-ca") pod "753bbff0-accb-431b-8a99-8fac2c2f0cd4" (UID: "753bbff0-accb-431b-8a99-8fac2c2f0cd4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:21.174888 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.174758    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "753bbff0-accb-431b-8a99-8fac2c2f0cd4" (UID: "753bbff0-accb-431b-8a99-8fac2c2f0cd4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:21.176506 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.176478    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "753bbff0-accb-431b-8a99-8fac2c2f0cd4" (UID: "753bbff0-accb-431b-8a99-8fac2c2f0cd4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:21.176549 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.176489    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753bbff0-accb-431b-8a99-8fac2c2f0cd4-kube-api-access-d4j9z" (OuterVolumeSpecName: "kube-api-access-d4j9z") pod "753bbff0-accb-431b-8a99-8fac2c2f0cd4" (UID: "753bbff0-accb-431b-8a99-8fac2c2f0cd4"). InnerVolumeSpecName "kube-api-access-d4j9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:50:21.176549 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.176491    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "753bbff0-accb-431b-8a99-8fac2c2f0cd4" (UID: "753bbff0-accb-431b-8a99-8fac2c2f0cd4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:21.276022 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.275979    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:21.276022 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.276015    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-trusted-ca-bundle\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:21.276022 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.276028    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-serving-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:21.276256 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.276040    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:21.276256 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.276054    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753bbff0-accb-431b-8a99-8fac2c2f0cd4-console-oauth-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:21.276256 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.276066    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4j9z\" (UniqueName: \"kubernetes.io/projected/753bbff0-accb-431b-8a99-8fac2c2f0cd4-kube-api-access-d4j9z\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:21.354513 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.354468    2558 generic.go:356] "Generic (PLEG): container finished" podID="753bbff0-accb-431b-8a99-8fac2c2f0cd4" containerID="5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce" exitCode=0
Jul 11 03:50:21.354695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.354538    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76494b57b5-j8lct"
Jul 11 03:50:21.354695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.354549    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76494b57b5-j8lct" event={"ID":"753bbff0-accb-431b-8a99-8fac2c2f0cd4","Type":"ContainerDied","Data":"5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce"}
Jul 11 03:50:21.354695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.354643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76494b57b5-j8lct" event={"ID":"753bbff0-accb-431b-8a99-8fac2c2f0cd4","Type":"ContainerDied","Data":"d07f49227f688c0ec1767ef924a15c09af8afc0e77ddeb285e078831cbb757f5"}
Jul 11 03:50:21.354695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.354671    2558 scope.go:117] "RemoveContainer" containerID="5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce"
Jul 11 03:50:21.356121 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.356100    2558 generic.go:356] "Generic (PLEG): container finished" podID="dc91ca83-83d5-4303-9683-06cf1e241801" containerID="3cbfad9b64ee7e5c9ac714ba06d31e9b24aa9dad7921ee72cc70798f93f6abd9" exitCode=0
Jul 11 03:50:21.356223 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.356174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb" event={"ID":"dc91ca83-83d5-4303-9683-06cf1e241801","Type":"ContainerDied","Data":"3cbfad9b64ee7e5c9ac714ba06d31e9b24aa9dad7921ee72cc70798f93f6abd9"}
Jul 11 03:50:21.356620 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.356603    2558 scope.go:117] "RemoveContainer" containerID="3cbfad9b64ee7e5c9ac714ba06d31e9b24aa9dad7921ee72cc70798f93f6abd9"
Jul 11 03:50:21.357878 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.357858    2558 generic.go:356] "Generic (PLEG): container finished" podID="df1ba85f-731d-4460-8461-0e7a5b26e335" containerID="7234a7fd81875860fc65598528ae8941c8b3b181f44a3a6f975dd83f1e49c205" exitCode=0
Jul 11 03:50:21.357981 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.357936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z" event={"ID":"df1ba85f-731d-4460-8461-0e7a5b26e335","Type":"ContainerDied","Data":"7234a7fd81875860fc65598528ae8941c8b3b181f44a3a6f975dd83f1e49c205"}
Jul 11 03:50:21.358210 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.358194    2558 scope.go:117] "RemoveContainer" containerID="7234a7fd81875860fc65598528ae8941c8b3b181f44a3a6f975dd83f1e49c205"
Jul 11 03:50:21.364411 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.364392    2558 scope.go:117] "RemoveContainer" containerID="5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce"
Jul 11 03:50:21.364704 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:50:21.364679    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce\": container with ID starting with 5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce not found: ID does not exist" containerID="5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce"
Jul 11 03:50:21.364782 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.364715    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce"} err="failed to get container status \"5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce\": rpc error: code = NotFound desc = could not find container \"5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce\": container with ID starting with 5074861b92195ce84038b581219637f7ce2e1619c94c57b625eddd8c3f1af5ce not found: ID does not exist"
Jul 11 03:50:21.402764 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.402737    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76494b57b5-j8lct"]
Jul 11 03:50:21.409540 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.409511    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76494b57b5-j8lct"]
Jul 11 03:50:21.539026 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:21.538999    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753bbff0-accb-431b-8a99-8fac2c2f0cd4" path="/var/lib/kubelet/pods/753bbff0-accb-431b-8a99-8fac2c2f0cd4/volumes"
Jul 11 03:50:22.365529 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:22.365486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wxggb" event={"ID":"dc91ca83-83d5-4303-9683-06cf1e241801","Type":"ContainerStarted","Data":"cbc7af3b56b1e919d89a7202f25201005299ecbd52f669febac03f5e77d45626"}
Jul 11 03:50:22.367469 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:22.367440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kd58z" event={"ID":"df1ba85f-731d-4460-8461-0e7a5b26e335","Type":"ContainerStarted","Data":"0ccf49c8b6d2ebba8ecf365abddf14faaa14e8c68e5bf585ccfe722cb7b4c103"}
Jul 11 03:50:23.215245 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.215201    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn" podUID="20520741-dec4-4e5e-a45a-b213d543aa38" containerName="registry" containerID="cri-o://7a871f3d9bce6d319e166d900c4064f7e7bedb3b006e26251c63bdc1a8e3353b" gracePeriod=30
Jul 11 03:50:23.373666 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.373624    2558 generic.go:356] "Generic (PLEG): container finished" podID="20520741-dec4-4e5e-a45a-b213d543aa38" containerID="7a871f3d9bce6d319e166d900c4064f7e7bedb3b006e26251c63bdc1a8e3353b" exitCode=0
Jul 11 03:50:23.374071 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.373690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn" event={"ID":"20520741-dec4-4e5e-a45a-b213d543aa38","Type":"ContainerDied","Data":"7a871f3d9bce6d319e166d900c4064f7e7bedb3b006e26251c63bdc1a8e3353b"}
Jul 11 03:50:23.469476 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.469411    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:50:23.496619 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496586    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.496787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496642    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20520741-dec4-4e5e-a45a-b213d543aa38-ca-trust-extracted\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.496787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496684    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzj8p\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-kube-api-access-wzj8p\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.496787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496720    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-installation-pull-secrets\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.496787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496759    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-image-registry-private-configuration\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.497007 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-bound-sa-token\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.497007 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496832    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-trusted-ca\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.497007 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.496882    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-registry-certificates\") pod \"20520741-dec4-4e5e-a45a-b213d543aa38\" (UID: \"20520741-dec4-4e5e-a45a-b213d543aa38\") "
Jul 11 03:50:23.497977 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.497940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:23.498309 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.498283    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:23.502609 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.502541    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:50:23.502609 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.502583    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:23.502770 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.502625    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-kube-api-access-wzj8p" (OuterVolumeSpecName: "kube-api-access-wzj8p") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "kube-api-access-wzj8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:50:23.502770 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.502699    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:23.503186 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.503157    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:50:23.518547 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.518515    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20520741-dec4-4e5e-a45a-b213d543aa38-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "20520741-dec4-4e5e-a45a-b213d543aa38" (UID: "20520741-dec4-4e5e-a45a-b213d543aa38"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:50:23.597974 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.597938    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20520741-dec4-4e5e-a45a-b213d543aa38-ca-trust-extracted\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:23.597974 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.597964    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzj8p\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-kube-api-access-wzj8p\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:23.597974 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.597976    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-installation-pull-secrets\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:23.598202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.597986    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20520741-dec4-4e5e-a45a-b213d543aa38-image-registry-private-configuration\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:23.598202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.597996    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-bound-sa-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:23.598202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.598005    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-trusted-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:23.598202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.598012    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20520741-dec4-4e5e-a45a-b213d543aa38-registry-certificates\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:23.598202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:23.598021    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20520741-dec4-4e5e-a45a-b213d543aa38-registry-tls\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:24.380946 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:24.380918    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn"
Jul 11 03:50:24.381440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:24.380916    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764d4d74b9-f8qrn" event={"ID":"20520741-dec4-4e5e-a45a-b213d543aa38","Type":"ContainerDied","Data":"0bec7f98a159e9a6fc88a538687cf132ff208564789c1942fcb04193c303f8a7"}
Jul 11 03:50:24.381440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:24.381072    2558 scope.go:117] "RemoveContainer" containerID="7a871f3d9bce6d319e166d900c4064f7e7bedb3b006e26251c63bdc1a8e3353b"
Jul 11 03:50:24.400111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:24.400071    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-764d4d74b9-f8qrn"]
Jul 11 03:50:24.403860 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:24.403826    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-764d4d74b9-f8qrn"]
Jul 11 03:50:24.448119 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:24.448078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:25.537737 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:25.537707    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20520741-dec4-4e5e-a45a-b213d543aa38" path="/var/lib/kubelet/pods/20520741-dec4-4e5e-a45a-b213d543aa38/volumes"
Jul 11 03:50:26.026655 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:26.026619    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:26.076037 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:26.076001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:50:38.955140 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:38.955078    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58df968c69-l8xk9" podUID="6311fecb-46c0-44d6-936a-81f87a69b2ef" containerName="console" containerID="cri-o://d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09" gracePeriod=15
Jul 11 03:50:39.247568 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.247536    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:50:39.321187 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321152    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-serving-cert\") pod \"6311fecb-46c0-44d6-936a-81f87a69b2ef\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") "
Jul 11 03:50:39.321187 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321188    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th45x\" (UniqueName: \"kubernetes.io/projected/6311fecb-46c0-44d6-936a-81f87a69b2ef-kube-api-access-th45x\") pod \"6311fecb-46c0-44d6-936a-81f87a69b2ef\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") "
Jul 11 03:50:39.321437 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321205    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-oauth-serving-cert\") pod \"6311fecb-46c0-44d6-936a-81f87a69b2ef\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") "
Jul 11 03:50:39.321437 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-service-ca\") pod \"6311fecb-46c0-44d6-936a-81f87a69b2ef\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") "
Jul 11 03:50:39.321437 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321259    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-oauth-config\") pod \"6311fecb-46c0-44d6-936a-81f87a69b2ef\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") "
Jul 11 03:50:39.321696 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321677    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-config\") pod \"6311fecb-46c0-44d6-936a-81f87a69b2ef\" (UID: \"6311fecb-46c0-44d6-936a-81f87a69b2ef\") "
Jul 11 03:50:39.321791 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321620    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6311fecb-46c0-44d6-936a-81f87a69b2ef" (UID: "6311fecb-46c0-44d6-936a-81f87a69b2ef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:39.321791 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.321636    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-service-ca" (OuterVolumeSpecName: "service-ca") pod "6311fecb-46c0-44d6-936a-81f87a69b2ef" (UID: "6311fecb-46c0-44d6-936a-81f87a69b2ef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:39.322076 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.322053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-config" (OuterVolumeSpecName: "console-config") pod "6311fecb-46c0-44d6-936a-81f87a69b2ef" (UID: "6311fecb-46c0-44d6-936a-81f87a69b2ef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:39.322143 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.322110    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-oauth-serving-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:39.322143 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.322125    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-service-ca\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:39.323567 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.323538    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6311fecb-46c0-44d6-936a-81f87a69b2ef" (UID: "6311fecb-46c0-44d6-936a-81f87a69b2ef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:39.323676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.323539    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6311fecb-46c0-44d6-936a-81f87a69b2ef-kube-api-access-th45x" (OuterVolumeSpecName: "kube-api-access-th45x") pod "6311fecb-46c0-44d6-936a-81f87a69b2ef" (UID: "6311fecb-46c0-44d6-936a-81f87a69b2ef"). InnerVolumeSpecName "kube-api-access-th45x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:50:39.323676 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.323641    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6311fecb-46c0-44d6-936a-81f87a69b2ef" (UID: "6311fecb-46c0-44d6-936a-81f87a69b2ef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:39.422637 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.422600    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-oauth-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:39.422637 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.422635    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-config\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:39.422866 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.422650    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6311fecb-46c0-44d6-936a-81f87a69b2ef-console-serving-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:39.422866 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.422663    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th45x\" (UniqueName: \"kubernetes.io/projected/6311fecb-46c0-44d6-936a-81f87a69b2ef-kube-api-access-th45x\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:50:39.446988 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.446953    2558 generic.go:356] "Generic (PLEG): container finished" podID="6311fecb-46c0-44d6-936a-81f87a69b2ef" containerID="d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09" exitCode=0
Jul 11 03:50:39.447162 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.447022    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58df968c69-l8xk9"
Jul 11 03:50:39.447162 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.447024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58df968c69-l8xk9" event={"ID":"6311fecb-46c0-44d6-936a-81f87a69b2ef","Type":"ContainerDied","Data":"d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09"}
Jul 11 03:50:39.447265 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.447164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58df968c69-l8xk9" event={"ID":"6311fecb-46c0-44d6-936a-81f87a69b2ef","Type":"ContainerDied","Data":"5579604bf6a8c5e65d3b5907dc87925ebb613bf338620192b58d27b17f0b0a6e"}
Jul 11 03:50:39.447265 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.447185    2558 scope.go:117] "RemoveContainer" containerID="d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09"
Jul 11 03:50:39.455991 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.455972    2558 scope.go:117] "RemoveContainer" containerID="d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09"
Jul 11 03:50:39.456277 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:50:39.456259    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09\": container with ID starting with d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09 not found: ID does not exist" containerID="d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09"
Jul 11 03:50:39.456329 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.456286    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09"} err="failed to get container status \"d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09\": rpc error: code = NotFound desc = could not find container \"d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09\": container with ID starting with d2a00fe5ca0f34bfcb3e8d5f7416e4fcc2b8fdefe61e5195091ac6003dc58c09 not found: ID does not exist"
Jul 11 03:50:39.466996 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.466937    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58df968c69-l8xk9"]
Jul 11 03:50:39.470334 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.470311    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58df968c69-l8xk9"]
Jul 11 03:50:39.537415 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:39.537379    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6311fecb-46c0-44d6-936a-81f87a69b2ef" path="/var/lib/kubelet/pods/6311fecb-46c0-44d6-936a-81f87a69b2ef/volumes"
Jul 11 03:50:56.768523 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:50:56.768472    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:06.650768 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:06.650727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:06.698826 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:06.698760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:17.884913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:17.884832    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:17.933090 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:17.933059    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:18.571352 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:18.571317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:18.617265 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:18.617229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:22.882030 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:22.881996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:22.982254 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:22.982221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:28.301152 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:28.301118    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:28.401494 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:28.401460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:28.451605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:28.451568    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:40.641150 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:40.641106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:40.741173 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:40.741127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:42.290679 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:42.290640    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:51:42.336441 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:51:42.336400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:02.120727 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:02.120689    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:02.935019 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:02.934986    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:05.727035 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:05.726995    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:05.775023 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:05.774990    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:06.776131 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:06.776091    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:06.889040 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:06.889007    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:07.605123 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:07.605089    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:07.705724 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:07.705684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:09.812745 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:09.812702    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:10.196040 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:10.196000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:12.519982 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:12.519938    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:12.571491 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:12.571451    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:17.804021 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:17.803985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:17.849907 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:17.849872    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:20.006158 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:20.006123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:20.104084 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:20.104045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:26.067984 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:26.067943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:26.174038 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:26.174002    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:27.927681 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:27.927643    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:31.219042 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:31.219009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:31.271061 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:31.271021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:37.580890 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:37.580852    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:41.563107 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:41.563074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:41.656382 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:41.656345    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.096669 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.096632    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.182334 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.182298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.293029 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.292996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.490459 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.490429    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.594378 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.594335    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.622393 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622363    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"]
Jul 11 03:52:42.622683 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622671    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753bbff0-accb-431b-8a99-8fac2c2f0cd4" containerName="console"
Jul 11 03:52:42.622726 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622684    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="753bbff0-accb-431b-8a99-8fac2c2f0cd4" containerName="console"
Jul 11 03:52:42.622726 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622700    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6311fecb-46c0-44d6-936a-81f87a69b2ef" containerName="console"
Jul 11 03:52:42.622726 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622705    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6311fecb-46c0-44d6-936a-81f87a69b2ef" containerName="console"
Jul 11 03:52:42.622726 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622720    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20520741-dec4-4e5e-a45a-b213d543aa38" containerName="registry"
Jul 11 03:52:42.622726 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622726    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="20520741-dec4-4e5e-a45a-b213d543aa38" containerName="registry"
Jul 11 03:52:42.622938 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622778    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6311fecb-46c0-44d6-936a-81f87a69b2ef" containerName="console"
Jul 11 03:52:42.622938 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622786    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="20520741-dec4-4e5e-a45a-b213d543aa38" containerName="registry"
Jul 11 03:52:42.622938 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.622792    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="753bbff0-accb-431b-8a99-8fac2c2f0cd4" containerName="console"
Jul 11 03:52:42.625687 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.625672    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.628390 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.628355    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 11 03:52:42.628541 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.628463    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-frqbb\""
Jul 11 03:52:42.628645 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.628625    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 11 03:52:42.628704 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.628625    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 11 03:52:42.629013 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.628999    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 11 03:52:42.640220 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.640201    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"]
Jul 11 03:52:42.715669 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.715635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwzll\" (UniqueName: \"kubernetes.io/projected/5731fc91-ecc1-4fb3-82db-262f0b3a715b-kube-api-access-dwzll\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.715920 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.715686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5731fc91-ecc1-4fb3-82db-262f0b3a715b-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.715920 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.715779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5731fc91-ecc1-4fb3-82db-262f0b3a715b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.715920 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.715835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5731fc91-ecc1-4fb3-82db-262f0b3a715b-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.715920 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.715866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5731fc91-ecc1-4fb3-82db-262f0b3a715b-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.795623 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.795534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.816749 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.816720    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5731fc91-ecc1-4fb3-82db-262f0b3a715b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.816913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.816754    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5731fc91-ecc1-4fb3-82db-262f0b3a715b-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.816913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.816774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5731fc91-ecc1-4fb3-82db-262f0b3a715b-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.816913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.816834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwzll\" (UniqueName: \"kubernetes.io/projected/5731fc91-ecc1-4fb3-82db-262f0b3a715b-kube-api-access-dwzll\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.816913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.816869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5731fc91-ecc1-4fb3-82db-262f0b3a715b-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.817217 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.817187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5731fc91-ecc1-4fb3-82db-262f0b3a715b-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.819089 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.819058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5731fc91-ecc1-4fb3-82db-262f0b3a715b-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.819215 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.819171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5731fc91-ecc1-4fb3-82db-262f0b3a715b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.819339 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.819319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5731fc91-ecc1-4fb3-82db-262f0b3a715b-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.824941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.824913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwzll\" (UniqueName: \"kubernetes.io/projected/5731fc91-ecc1-4fb3-82db-262f0b3a715b-kube-api-access-dwzll\") pod \"opendatahub-operator-controller-manager-84f9769f6c-8brch\" (UID: \"5731fc91-ecc1-4fb3-82db-262f0b3a715b\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.896392 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.896355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:42.936522 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.936481    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:42.996715 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:42.996643    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:43.073540 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:43.073518    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"]
Jul 11 03:52:43.075484 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:52:43.075456    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5731fc91_ecc1_4fb3_82db_262f0b3a715b.slice/crio-6f3088d20ce54fcd454dfe7dbaa4baf23aed3d71ee69578e4d0c7ab530c9e473 WatchSource:0}: Error finding container 6f3088d20ce54fcd454dfe7dbaa4baf23aed3d71ee69578e4d0c7ab530c9e473: Status 404 returned error can't find the container with id 6f3088d20ce54fcd454dfe7dbaa4baf23aed3d71ee69578e4d0c7ab530c9e473
Jul 11 03:52:43.078347 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:43.078320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:43.148014 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:43.147977    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:43.262064 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:43.262031    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:43.955838 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:43.955663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch" event={"ID":"5731fc91-ecc1-4fb3-82db-262f0b3a715b","Type":"ContainerStarted","Data":"6f3088d20ce54fcd454dfe7dbaa4baf23aed3d71ee69578e4d0c7ab530c9e473"}
Jul 11 03:52:46.972532 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:46.972493    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch" event={"ID":"5731fc91-ecc1-4fb3-82db-262f0b3a715b","Type":"ContainerStarted","Data":"6bf0eaee9745fcfcea34a1f902a3dc3147c9b1b31782c3b6dc92d9f853d84435"}
Jul 11 03:52:47.977674 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:47.977635    2558 generic.go:356] "Generic (PLEG): container finished" podID="5731fc91-ecc1-4fb3-82db-262f0b3a715b" containerID="6bf0eaee9745fcfcea34a1f902a3dc3147c9b1b31782c3b6dc92d9f853d84435" exitCode=0
Jul 11 03:52:47.978102 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:47.977724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch" event={"ID":"5731fc91-ecc1-4fb3-82db-262f0b3a715b","Type":"ContainerDied","Data":"6bf0eaee9745fcfcea34a1f902a3dc3147c9b1b31782c3b6dc92d9f853d84435"}
Jul 11 03:52:48.983930 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:48.983896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch" event={"ID":"5731fc91-ecc1-4fb3-82db-262f0b3a715b","Type":"ContainerStarted","Data":"ab8d721c35920e862f5d9b5d59d86cc4a5af8706eb9b6eb10bd6a42e4e72636a"}
Jul 11 03:52:48.984315 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:48.984037    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:52:49.005168 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:49.005116    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch" podStartSLOduration=2.708834681 podStartE2EDuration="7.005099207s" totalImagesPullingTime="3.274886295s" totalInitContainerRuntime="1.021378231s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:49.00391283 +0000 UTC m=+268.087515169" watchObservedRunningTime="2026-07-11 03:52:49.005099207 +0000 UTC m=+268.088701585"
Jul 11 03:52:54.568612 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:54.568573    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:54.663290 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:54.663241    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:52:59.991414 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:52:59.991380    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-8brch"
Jul 11 03:53:02.452287 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:02.452256    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:02.545247 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:02.545207    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:07.944267 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:07.944227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:08.092576 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.092544    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"]
Jul 11 03:53:08.107338 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.107307    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"]
Jul 11 03:53:08.107520 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.107440    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.109948 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.109921    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 11 03:53:08.110108 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.109986    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 11 03:53:08.110108 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.109987    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5t74l\""
Jul 11 03:53:08.193525 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.193490    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7496v"]
Jul 11 03:53:08.196829 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.196775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.199222 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.199196    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rn9bx\""
Jul 11 03:53:08.199337 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.199194    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 11 03:53:08.207892 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.207871    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7496v"]
Jul 11 03:53:08.208694 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.208671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4de92070-e926-4bc3-b302-84ca89309913-tmp\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.208919 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.208899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de92070-e926-4bc3-b302-84ca89309913-tls-certs\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.209119 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.209077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wqx5\" (UniqueName: \"kubernetes.io/projected/4de92070-e926-4bc3-b302-84ca89309913-kube-api-access-8wqx5\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.232865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.232827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:08.310015 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.309979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/330e4cd1-862b-4997-8d27-f71b445e21b3-cert\") pod \"odh-model-controller-7998c67dc4-7496v\" (UID: \"330e4cd1-862b-4997-8d27-f71b445e21b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.310190 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.310036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4de92070-e926-4bc3-b302-84ca89309913-tmp\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.310190 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.310091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de92070-e926-4bc3-b302-84ca89309913-tls-certs\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.310190 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.310140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wqx5\" (UniqueName: \"kubernetes.io/projected/4de92070-e926-4bc3-b302-84ca89309913-kube-api-access-8wqx5\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.310190 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.310165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8wnn\" (UniqueName: \"kubernetes.io/projected/330e4cd1-862b-4997-8d27-f71b445e21b3-kube-api-access-r8wnn\") pod \"odh-model-controller-7998c67dc4-7496v\" (UID: \"330e4cd1-862b-4997-8d27-f71b445e21b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.312183 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.312155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4de92070-e926-4bc3-b302-84ca89309913-tmp\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.312403 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.312386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de92070-e926-4bc3-b302-84ca89309913-tls-certs\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.317154 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.317135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wqx5\" (UniqueName: \"kubernetes.io/projected/4de92070-e926-4bc3-b302-84ca89309913-kube-api-access-8wqx5\") pod \"kube-auth-proxy-7b7c6c587f-hz8th\" (UID: \"4de92070-e926-4bc3-b302-84ca89309913\") " pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.334524 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.334492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:08.410589 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.410556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wnn\" (UniqueName: \"kubernetes.io/projected/330e4cd1-862b-4997-8d27-f71b445e21b3-kube-api-access-r8wnn\") pod \"odh-model-controller-7998c67dc4-7496v\" (UID: \"330e4cd1-862b-4997-8d27-f71b445e21b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.410763 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.410601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/330e4cd1-862b-4997-8d27-f71b445e21b3-cert\") pod \"odh-model-controller-7998c67dc4-7496v\" (UID: \"330e4cd1-862b-4997-8d27-f71b445e21b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.410763 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:53:08.410709    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 11 03:53:08.410763 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:53:08.410760    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330e4cd1-862b-4997-8d27-f71b445e21b3-cert podName:330e4cd1-862b-4997-8d27-f71b445e21b3 nodeName:}" failed. No retries permitted until 2026-07-11 03:53:08.910744061 +0000 UTC m=+287.994346352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/330e4cd1-862b-4997-8d27-f71b445e21b3-cert") pod "odh-model-controller-7998c67dc4-7496v" (UID: "330e4cd1-862b-4997-8d27-f71b445e21b3") : secret "odh-model-controller-webhook-cert" not found
Jul 11 03:53:08.419106 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.419078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8wnn\" (UniqueName: \"kubernetes.io/projected/330e4cd1-862b-4997-8d27-f71b445e21b3-kube-api-access-r8wnn\") pod \"odh-model-controller-7998c67dc4-7496v\" (UID: \"330e4cd1-862b-4997-8d27-f71b445e21b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.419233 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.419221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"
Jul 11 03:53:08.433091 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.433061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:08.513437 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.513387    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k2ptl"]
Jul 11 03:53:08.517409 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.517385    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.520315 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.520293    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 11 03:53:08.533858 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.533571    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k2ptl"]
Jul 11 03:53:08.536110 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.536062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:08.584519 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.584490    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th"]
Jul 11 03:53:08.587132 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:53:08.587105    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de92070_e926_4bc3_b302_84ca89309913.slice/crio-a5d7e533965f829a8b43c5d14278a84049d12b64bfe04bf07a64604df6a78d38 WatchSource:0}: Error finding container a5d7e533965f829a8b43c5d14278a84049d12b64bfe04bf07a64604df6a78d38: Status 404 returned error can't find the container with id a5d7e533965f829a8b43c5d14278a84049d12b64bfe04bf07a64604df6a78d38
Jul 11 03:53:08.613080 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.613052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c720e155-b4dc-4026-9435-60e6edc1b0b3-tls-certs\") pod \"model-serving-api-54d89bd5fc-k2ptl\" (UID: \"c720e155-b4dc-4026-9435-60e6edc1b0b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.613224 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.613117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l56w2\" (UniqueName: \"kubernetes.io/projected/c720e155-b4dc-4026-9435-60e6edc1b0b3-kube-api-access-l56w2\") pod \"model-serving-api-54d89bd5fc-k2ptl\" (UID: \"c720e155-b4dc-4026-9435-60e6edc1b0b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.681741 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.681707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:08.713975 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.713942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l56w2\" (UniqueName: \"kubernetes.io/projected/c720e155-b4dc-4026-9435-60e6edc1b0b3-kube-api-access-l56w2\") pod \"model-serving-api-54d89bd5fc-k2ptl\" (UID: \"c720e155-b4dc-4026-9435-60e6edc1b0b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.714130 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.714031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c720e155-b4dc-4026-9435-60e6edc1b0b3-tls-certs\") pod \"model-serving-api-54d89bd5fc-k2ptl\" (UID: \"c720e155-b4dc-4026-9435-60e6edc1b0b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.716762 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.716740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c720e155-b4dc-4026-9435-60e6edc1b0b3-tls-certs\") pod \"model-serving-api-54d89bd5fc-k2ptl\" (UID: \"c720e155-b4dc-4026-9435-60e6edc1b0b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.725084 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.725062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l56w2\" (UniqueName: \"kubernetes.io/projected/c720e155-b4dc-4026-9435-60e6edc1b0b3-kube-api-access-l56w2\") pod \"model-serving-api-54d89bd5fc-k2ptl\" (UID: \"c720e155-b4dc-4026-9435-60e6edc1b0b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.781753 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.781664    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:08.831707 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.831671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:08.916200 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.916163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/330e4cd1-862b-4997-8d27-f71b445e21b3-cert\") pod \"odh-model-controller-7998c67dc4-7496v\" (UID: \"330e4cd1-862b-4997-8d27-f71b445e21b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.919932 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.919886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/330e4cd1-862b-4997-8d27-f71b445e21b3-cert\") pod \"odh-model-controller-7998c67dc4-7496v\" (UID: \"330e4cd1-862b-4997-8d27-f71b445e21b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:08.973736 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:08.973638    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-k2ptl"]
Jul 11 03:53:08.976497 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:53:08.976467    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc720e155_b4dc_4026_9435_60e6edc1b0b3.slice/crio-fe41697c45605f730fdcac8f5c01b1548bb2368289bfc461591ebdb5d4f96030 WatchSource:0}: Error finding container fe41697c45605f730fdcac8f5c01b1548bb2368289bfc461591ebdb5d4f96030: Status 404 returned error can't find the container with id fe41697c45605f730fdcac8f5c01b1548bb2368289bfc461591ebdb5d4f96030
Jul 11 03:53:09.068250 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.068158    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl" event={"ID":"c720e155-b4dc-4026-9435-60e6edc1b0b3","Type":"ContainerStarted","Data":"fe41697c45605f730fdcac8f5c01b1548bb2368289bfc461591ebdb5d4f96030"}
Jul 11 03:53:09.069244 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.069220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th" event={"ID":"4de92070-e926-4bc3-b302-84ca89309913","Type":"ContainerStarted","Data":"a5d7e533965f829a8b43c5d14278a84049d12b64bfe04bf07a64604df6a78d38"}
Jul 11 03:53:09.107267 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.107234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:09.246718 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.246502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7496v"]
Jul 11 03:53:09.249656 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:53:09.249626    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330e4cd1_862b_4997_8d27_f71b445e21b3.slice/crio-191e9a1a448e68e6f8427e7bc59fbb387abd702760946926ceaf2e2141cab3e7 WatchSource:0}: Error finding container 191e9a1a448e68e6f8427e7bc59fbb387abd702760946926ceaf2e2141cab3e7: Status 404 returned error can't find the container with id 191e9a1a448e68e6f8427e7bc59fbb387abd702760946926ceaf2e2141cab3e7
Jul 11 03:53:09.264015 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.263983    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:09.271169 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.271142    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"]
Jul 11 03:53:09.274939 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.274920    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.277821 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.277784    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 11 03:53:09.277931 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.277849    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 11 03:53:09.277931 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.277827    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 11 03:53:09.278051 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.277850    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kdvwm\""
Jul 11 03:53:09.278051 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.277784    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 11 03:53:09.285843 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.285820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"]
Jul 11 03:53:09.320001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.319923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-cacerts\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.320001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.319974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.320001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.319998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j6mc\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-kube-api-access-5j6mc\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.320276 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.320019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a046b1-7323-4e50-a1a0-c22df9468806-local-certs\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.320276 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.320143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.320276 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.320165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.320276 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.320194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-token\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.363784 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.363745    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:09.427065 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.426660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-cacerts\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.427260 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.427108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.427260 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.427132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j6mc\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-kube-api-access-5j6mc\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.427260 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.427163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a046b1-7323-4e50-a1a0-c22df9468806-local-certs\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.427260 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.427227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.427260 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.427259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.427521 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.427291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-token\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.428206 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.428180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.429721 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.429696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a046b1-7323-4e50-a1a0-c22df9468806-local-certs\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.429916 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.429886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-cacerts\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.430104 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.430080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.430943 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.430920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.435030 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.435005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-token\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.435636 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.435616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j6mc\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-kube-api-access-5j6mc\") pod \"istiod-openshift-gateway-7574459656-ksbn6\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.586854 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.586754    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:09.734090 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:09.734060    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"]
Jul 11 03:53:09.735896 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:53:09.735856    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a046b1_7323_4e50_a1a0_c22df9468806.slice/crio-92f00ad294cf9e3a72b2480e9a98a955c63d7b4814b2313beb9996093fe6e6a1 WatchSource:0}: Error finding container 92f00ad294cf9e3a72b2480e9a98a955c63d7b4814b2313beb9996093fe6e6a1: Status 404 returned error can't find the container with id 92f00ad294cf9e3a72b2480e9a98a955c63d7b4814b2313beb9996093fe6e6a1
Jul 11 03:53:10.077578 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:10.077533    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" event={"ID":"e2a046b1-7323-4e50-a1a0-c22df9468806","Type":"ContainerStarted","Data":"92f00ad294cf9e3a72b2480e9a98a955c63d7b4814b2313beb9996093fe6e6a1"}
Jul 11 03:53:10.079105 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:10.079077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7496v" event={"ID":"330e4cd1-862b-4997-8d27-f71b445e21b3","Type":"ContainerStarted","Data":"191e9a1a448e68e6f8427e7bc59fbb387abd702760946926ceaf2e2141cab3e7"}
Jul 11 03:53:10.142837 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:10.142644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:14.052966 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:14.049517    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:53:14.052966 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:14.049636    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:53:15.106647 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.106604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th" event={"ID":"4de92070-e926-4bc3-b302-84ca89309913","Type":"ContainerStarted","Data":"45705f661e9d6b744e8029e32400ee2c0a7d03dfa10ee1cd59bd1f5a432e073e"}
Jul 11 03:53:15.108574 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.108544    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" event={"ID":"e2a046b1-7323-4e50-a1a0-c22df9468806","Type":"ContainerStarted","Data":"3d60131d16aa224b6b984de7198130689a5fb95721562a1a6a6a132b5a0651b2"}
Jul 11 03:53:15.108756 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.108734    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:15.110746 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.110722    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl" event={"ID":"c720e155-b4dc-4026-9435-60e6edc1b0b3","Type":"ContainerStarted","Data":"0cd1ecf68c435d5072cfe9f9acdff288a6d1eb2bf5214e5f01e631302c89a02b"}
Jul 11 03:53:15.110746 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.110738    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ksbn6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 03:53:15.110983 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.110778    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" podUID="e2a046b1-7323-4e50-a1a0-c22df9468806" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 03:53:15.110983 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.110789    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:15.112489 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.112461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7496v" event={"ID":"330e4cd1-862b-4997-8d27-f71b445e21b3","Type":"ContainerStarted","Data":"753b91c134c9a3410ff7ec6d8c57d00ac415c6fa64848efe7a409652bbc4456b"}
Jul 11 03:53:15.112610 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.112597    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:15.126167 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.126114    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b7c6c587f-hz8th" podStartSLOduration=1.673650082 podStartE2EDuration="7.126094754s" totalImagesPullingTime="5.452444672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:15.123721166 +0000 UTC m=+294.207323503" watchObservedRunningTime="2026-07-11 03:53:15.126094754 +0000 UTC m=+294.209697068"
Jul 11 03:53:15.135659 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.135622    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:15.166543 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.166492    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl" podStartSLOduration=2.16536701 podStartE2EDuration="7.166476477s" totalImagesPullingTime="5.001109467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:15.142169553 +0000 UTC m=+294.225771866" watchObservedRunningTime="2026-07-11 03:53:15.166476477 +0000 UTC m=+294.250078789"
Jul 11 03:53:15.166745 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.166709    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" podStartSLOduration=1.85571157 podStartE2EDuration="6.166703117s" totalImagesPullingTime="4.310991547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:15.164923373 +0000 UTC m=+294.248525707" watchObservedRunningTime="2026-07-11 03:53:15.166703117 +0000 UTC m=+294.250305429"
Jul 11 03:53:15.183061 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.182974    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7496v" podStartSLOduration=2.374618373 podStartE2EDuration="7.182954323s" totalImagesPullingTime="4.80833595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:15.182881964 +0000 UTC m=+294.266484302" watchObservedRunningTime="2026-07-11 03:53:15.182954323 +0000 UTC m=+294.266556638"
Jul 11 03:53:15.228183 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.228151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:15.780584 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.780506    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"]
Jul 11 03:53:15.784276 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.784252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.786858 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.786820    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b4ktx\""
Jul 11 03:53:15.796444 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.796420    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"]
Jul 11 03:53:15.810626 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.810595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:15.888328 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxnqc\" (UniqueName: \"kubernetes.io/projected/207e9004-3250-4b66-91d6-01169131555e-kube-api-access-gxnqc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/207e9004-3250-4b66-91d6-01169131555e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/207e9004-3250-4b66-91d6-01169131555e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/207e9004-3250-4b66-91d6-01169131555e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888714 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888714 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.888714 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.888683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.987102 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.987062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:15.990063 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990158 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/207e9004-3250-4b66-91d6-01169131555e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990158 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/207e9004-3250-4b66-91d6-01169131555e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990158 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/207e9004-3250-4b66-91d6-01169131555e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990301 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990301 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990301 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990301 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxnqc\" (UniqueName: \"kubernetes.io/projected/207e9004-3250-4b66-91d6-01169131555e-kube-api-access-gxnqc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990490 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990551 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990507    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990686 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990788 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.990788 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.990735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.991042 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.991025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/207e9004-3250-4b66-91d6-01169131555e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.992527 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.992509    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/207e9004-3250-4b66-91d6-01169131555e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:15.992788 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:15.992774    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/207e9004-3250-4b66-91d6-01169131555e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:16.007228 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:16.007206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxnqc\" (UniqueName: \"kubernetes.io/projected/207e9004-3250-4b66-91d6-01169131555e-kube-api-access-gxnqc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:16.007868 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:16.007852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/207e9004-3250-4b66-91d6-01169131555e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vchkw\" (UID: \"207e9004-3250-4b66-91d6-01169131555e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:16.096752 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:16.096666    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:16.097537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:16.097510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:16.118931 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:16.118906    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:16.261449 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:16.261423    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"]
Jul 11 03:53:16.263231 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:53:16.263208    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207e9004_3250_4b66_91d6_01169131555e.slice/crio-eced6dedc92ddf9ab5cdfd9ff9b527fc73fcf84aab5507b4c2a7e51b18f92547 WatchSource:0}: Error finding container eced6dedc92ddf9ab5cdfd9ff9b527fc73fcf84aab5507b4c2a7e51b18f92547: Status 404 returned error can't find the container with id eced6dedc92ddf9ab5cdfd9ff9b527fc73fcf84aab5507b4c2a7e51b18f92547
Jul 11 03:53:17.124784 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:17.124741    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw" event={"ID":"207e9004-3250-4b66-91d6-01169131555e","Type":"ContainerStarted","Data":"eced6dedc92ddf9ab5cdfd9ff9b527fc73fcf84aab5507b4c2a7e51b18f92547"}
Jul 11 03:53:17.634588 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:17.634545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:17.785033 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:17.784975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:17.918116 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:17.918034    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:18.018218 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:18.018178    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:18.705731 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:18.705696    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"]
Jul 11 03:53:18.706201 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:18.705884    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" podUID="e2a046b1-7323-4e50-a1a0-c22df9468806" containerName="discovery" containerID="cri-o://3d60131d16aa224b6b984de7198130689a5fb95721562a1a6a6a132b5a0651b2" gracePeriod=30
Jul 11 03:53:18.933614 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:18.933533    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:19.035135 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.035098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:19.089308 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.089261    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:53:19.089421 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.089367    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:53:19.089459 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.089420    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:53:19.134576 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.134539    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:53:19.136471 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.136444    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2a046b1-7323-4e50-a1a0-c22df9468806" containerID="3d60131d16aa224b6b984de7198130689a5fb95721562a1a6a6a132b5a0651b2" exitCode=0
Jul 11 03:53:19.136574 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.136470    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" event={"ID":"e2a046b1-7323-4e50-a1a0-c22df9468806","Type":"ContainerDied","Data":"3d60131d16aa224b6b984de7198130689a5fb95721562a1a6a6a132b5a0651b2"}
Jul 11 03:53:19.180221 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.180200    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:19.321678 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.321595    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-cacerts\") pod \"e2a046b1-7323-4e50-a1a0-c22df9468806\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") "
Jul 11 03:53:19.321678 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.321645    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-dns-cert\") pod \"e2a046b1-7323-4e50-a1a0-c22df9468806\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") "
Jul 11 03:53:19.321678 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.321680    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a046b1-7323-4e50-a1a0-c22df9468806-local-certs\") pod \"e2a046b1-7323-4e50-a1a0-c22df9468806\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") "
Jul 11 03:53:19.321979 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.321696    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-token\") pod \"e2a046b1-7323-4e50-a1a0-c22df9468806\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") "
Jul 11 03:53:19.321979 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.321715    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j6mc\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-kube-api-access-5j6mc\") pod \"e2a046b1-7323-4e50-a1a0-c22df9468806\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") "
Jul 11 03:53:19.321979 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.321775    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-ca-configmap\") pod \"e2a046b1-7323-4e50-a1a0-c22df9468806\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") "
Jul 11 03:53:19.321979 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.321939    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-kubeconfig\") pod \"e2a046b1-7323-4e50-a1a0-c22df9468806\" (UID: \"e2a046b1-7323-4e50-a1a0-c22df9468806\") "
Jul 11 03:53:19.324698 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.324660    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2a046b1-7323-4e50-a1a0-c22df9468806" (UID: "e2a046b1-7323-4e50-a1a0-c22df9468806"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:53:19.325039 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.325008    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a046b1-7323-4e50-a1a0-c22df9468806-local-certs" (OuterVolumeSpecName: "local-certs") pod "e2a046b1-7323-4e50-a1a0-c22df9468806" (UID: "e2a046b1-7323-4e50-a1a0-c22df9468806"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:53:19.325156 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.325112    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e2a046b1-7323-4e50-a1a0-c22df9468806" (UID: "e2a046b1-7323-4e50-a1a0-c22df9468806"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:53:19.325265 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.325242    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-kube-api-access-5j6mc" (OuterVolumeSpecName: "kube-api-access-5j6mc") pod "e2a046b1-7323-4e50-a1a0-c22df9468806" (UID: "e2a046b1-7323-4e50-a1a0-c22df9468806"). InnerVolumeSpecName "kube-api-access-5j6mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:53:19.325335 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.325311    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e2a046b1-7323-4e50-a1a0-c22df9468806" (UID: "e2a046b1-7323-4e50-a1a0-c22df9468806"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:53:19.325684 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.325655    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e2a046b1-7323-4e50-a1a0-c22df9468806" (UID: "e2a046b1-7323-4e50-a1a0-c22df9468806"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:53:19.326058 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.326040    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-cacerts" (OuterVolumeSpecName: "cacerts") pod "e2a046b1-7323-4e50-a1a0-c22df9468806" (UID: "e2a046b1-7323-4e50-a1a0-c22df9468806"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:53:19.422819 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.422777    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-dns-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:53:19.422819 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.422819    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a046b1-7323-4e50-a1a0-c22df9468806-local-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:53:19.422819 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.422829    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:53:19.423106 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.422838    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j6mc\" (UniqueName: \"kubernetes.io/projected/e2a046b1-7323-4e50-a1a0-c22df9468806-kube-api-access-5j6mc\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:53:19.423106 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.422846    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-csr-ca-configmap\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:53:19.423106 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.422855    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-istio-kubeconfig\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:53:19.423106 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:19.422863    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2a046b1-7323-4e50-a1a0-c22df9468806-cacerts\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:53:20.143524 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:20.143484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw" event={"ID":"207e9004-3250-4b66-91d6-01169131555e","Type":"ContainerStarted","Data":"2ecc4ae92fed83c53c248126f876d095dd551c5e38fdd099b68d7202fe9cba5f"}
Jul 11 03:53:20.144763 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:20.144743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" event={"ID":"e2a046b1-7323-4e50-a1a0-c22df9468806","Type":"ContainerDied","Data":"92f00ad294cf9e3a72b2480e9a98a955c63d7b4814b2313beb9996093fe6e6a1"}
Jul 11 03:53:20.144851 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:20.144753    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"
Jul 11 03:53:20.144851 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:20.144785    2558 scope.go:117] "RemoveContainer" containerID="3d60131d16aa224b6b984de7198130689a5fb95721562a1a6a6a132b5a0651b2"
Jul 11 03:53:20.163195 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:20.163151    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw" podStartSLOduration=2.3394628920000002 podStartE2EDuration="5.163134984s" totalImagesPullingTime="2.823672092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:20.162275777 +0000 UTC m=+299.245878121" watchObservedRunningTime="2026-07-11 03:53:20.163134984 +0000 UTC m=+299.246737296"
Jul 11 03:53:20.174752 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:20.174724    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"]
Jul 11 03:53:20.178877 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:20.178850    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6"]
Jul 11 03:53:21.098541 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.098506    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:21.103305 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.103278    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:21.150098 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.150075    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:21.151076 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.151057    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vchkw"
Jul 11 03:53:21.482568 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.482487    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 03:53:21.482757 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.482602    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 03:53:21.501222 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.501198    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 11 03:53:21.537857 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:21.537738    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2a046b1-7323-4e50-a1a0-c22df9468806" path="/var/lib/kubelet/pods/e2a046b1-7323-4e50-a1a0-c22df9468806/volumes"
Jul 11 03:53:24.119109 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:24.119070    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ksbn6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 11 03:53:24.119523 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:24.119129    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ksbn6" podUID="e2a046b1-7323-4e50-a1a0-c22df9468806" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.33:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 11 03:53:26.120066 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:26.120034    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7496v"
Jul 11 03:53:26.124500 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:26.124479    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-k2ptl"
Jul 11 03:53:42.587639 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:53:42.587601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:03.819687 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.819655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:03.959714 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.959680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:03.984167 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.984133    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nchkw"]
Jul 11 03:54:03.984551 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.984533    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a046b1-7323-4e50-a1a0-c22df9468806" containerName="discovery"
Jul 11 03:54:03.984639 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.984553    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a046b1-7323-4e50-a1a0-c22df9468806" containerName="discovery"
Jul 11 03:54:03.984693 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.984645    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2a046b1-7323-4e50-a1a0-c22df9468806" containerName="discovery"
Jul 11 03:54:03.997768 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.997733    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nchkw"]
Jul 11 03:54:03.997923 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:03.997785    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nchkw"
Jul 11 03:54:04.000268 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.000242    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 03:54:04.001394 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.001372    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m8t7c\""
Jul 11 03:54:04.001706 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.001462    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 03:54:04.044471 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.044432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:04.098421 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.098398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnf5l\" (UniqueName: \"kubernetes.io/projected/15ce9f72-5e7f-42b6-8527-1d8cafe73b23-kube-api-access-mnf5l\") pod \"kuadrant-operator-catalog-nchkw\" (UID: \"15ce9f72-5e7f-42b6-8527-1d8cafe73b23\") " pod="kuadrant-system/kuadrant-operator-catalog-nchkw"
Jul 11 03:54:04.199787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.199751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnf5l\" (UniqueName: \"kubernetes.io/projected/15ce9f72-5e7f-42b6-8527-1d8cafe73b23-kube-api-access-mnf5l\") pod \"kuadrant-operator-catalog-nchkw\" (UID: \"15ce9f72-5e7f-42b6-8527-1d8cafe73b23\") " pod="kuadrant-system/kuadrant-operator-catalog-nchkw"
Jul 11 03:54:04.207288 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.207255    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnf5l\" (UniqueName: \"kubernetes.io/projected/15ce9f72-5e7f-42b6-8527-1d8cafe73b23-kube-api-access-mnf5l\") pod \"kuadrant-operator-catalog-nchkw\" (UID: \"15ce9f72-5e7f-42b6-8527-1d8cafe73b23\") " pod="kuadrant-system/kuadrant-operator-catalog-nchkw"
Jul 11 03:54:04.309163 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.309119    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nchkw"
Jul 11 03:54:04.439936 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.439914    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nchkw"]
Jul 11 03:54:04.442254 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:54:04.442230    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ce9f72_5e7f_42b6_8527_1d8cafe73b23.slice/crio-62ddd1f5f00f62c0db5fb0955bf4b2aab43c8c92167e5644b95ac71711502ffb WatchSource:0}: Error finding container 62ddd1f5f00f62c0db5fb0955bf4b2aab43c8c92167e5644b95ac71711502ffb: Status 404 returned error can't find the container with id 62ddd1f5f00f62c0db5fb0955bf4b2aab43c8c92167e5644b95ac71711502ffb
Jul 11 03:54:04.443559 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.443543    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 03:54:04.708633 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.708546    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nchkw"]
Jul 11 03:54:04.726154 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.726122    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hnbr8"]
Jul 11 03:54:04.731448 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.731425    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:04.737099 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.737066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hnbr8"]
Jul 11 03:54:04.756502 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.756470    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:04.804818 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.804774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97kgq\" (UniqueName: \"kubernetes.io/projected/3ed29283-9a27-4756-9d8c-f93a481d6231-kube-api-access-97kgq\") pod \"kuadrant-operator-catalog-hnbr8\" (UID: \"3ed29283-9a27-4756-9d8c-f93a481d6231\") " pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:04.905525 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.905484    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kgq\" (UniqueName: \"kubernetes.io/projected/3ed29283-9a27-4756-9d8c-f93a481d6231-kube-api-access-97kgq\") pod \"kuadrant-operator-catalog-hnbr8\" (UID: \"3ed29283-9a27-4756-9d8c-f93a481d6231\") " pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:04.916025 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.915995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97kgq\" (UniqueName: \"kubernetes.io/projected/3ed29283-9a27-4756-9d8c-f93a481d6231-kube-api-access-97kgq\") pod \"kuadrant-operator-catalog-hnbr8\" (UID: \"3ed29283-9a27-4756-9d8c-f93a481d6231\") " pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:04.953817 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:04.953769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:05.046034 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:05.045965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:05.191954 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:05.191933    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hnbr8"]
Jul 11 03:54:05.286343 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:54:05.286311    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed29283_9a27_4756_9d8c_f93a481d6231.slice/crio-a2114e8ce61dc5306457cf9b58b5c9719eddf1209b5e5a1e9b161d75d5f771a8 WatchSource:0}: Error finding container a2114e8ce61dc5306457cf9b58b5c9719eddf1209b5e5a1e9b161d75d5f771a8: Status 404 returned error can't find the container with id a2114e8ce61dc5306457cf9b58b5c9719eddf1209b5e5a1e9b161d75d5f771a8
Jul 11 03:54:05.344783 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:05.344691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nchkw" event={"ID":"15ce9f72-5e7f-42b6-8527-1d8cafe73b23","Type":"ContainerStarted","Data":"62ddd1f5f00f62c0db5fb0955bf4b2aab43c8c92167e5644b95ac71711502ffb"}
Jul 11 03:54:05.346096 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:05.346063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8" event={"ID":"3ed29283-9a27-4756-9d8c-f93a481d6231","Type":"ContainerStarted","Data":"a2114e8ce61dc5306457cf9b58b5c9719eddf1209b5e5a1e9b161d75d5f771a8"}
Jul 11 03:54:07.359654 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.359605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nchkw" event={"ID":"15ce9f72-5e7f-42b6-8527-1d8cafe73b23","Type":"ContainerStarted","Data":"afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6"}
Jul 11 03:54:07.359654 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.359629    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nchkw" podUID="15ce9f72-5e7f-42b6-8527-1d8cafe73b23" containerName="registry-server" containerID="cri-o://afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6" gracePeriod=2
Jul 11 03:54:07.361191 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.361166    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8" event={"ID":"3ed29283-9a27-4756-9d8c-f93a481d6231","Type":"ContainerStarted","Data":"00d7ed7d49d45d9139417b732e4781ec8e89f82fe782524efa7e6e0cd6e0a546"}
Jul 11 03:54:07.376229 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.376181    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nchkw" podStartSLOduration=2.336354987 podStartE2EDuration="4.376164203s" totalImagesPullingTime="2.039809216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:54:07.373878656 +0000 UTC m=+346.457480992" watchObservedRunningTime="2026-07-11 03:54:07.376164203 +0000 UTC m=+346.459766514"
Jul 11 03:54:07.388564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.388512    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8" podStartSLOduration=2.191742939 podStartE2EDuration="3.388496739s" totalImagesPullingTime="1.1967538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:54:07.387497146 +0000 UTC m=+346.471099459" watchObservedRunningTime="2026-07-11 03:54:07.388496739 +0000 UTC m=+346.472099051"
Jul 11 03:54:07.619530 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.619467    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nchkw"
Jul 11 03:54:07.734531 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.734491    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnf5l\" (UniqueName: \"kubernetes.io/projected/15ce9f72-5e7f-42b6-8527-1d8cafe73b23-kube-api-access-mnf5l\") pod \"15ce9f72-5e7f-42b6-8527-1d8cafe73b23\" (UID: \"15ce9f72-5e7f-42b6-8527-1d8cafe73b23\") "
Jul 11 03:54:07.736686 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.736648    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ce9f72-5e7f-42b6-8527-1d8cafe73b23-kube-api-access-mnf5l" (OuterVolumeSpecName: "kube-api-access-mnf5l") pod "15ce9f72-5e7f-42b6-8527-1d8cafe73b23" (UID: "15ce9f72-5e7f-42b6-8527-1d8cafe73b23"). InnerVolumeSpecName "kube-api-access-mnf5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:54:07.835560 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:07.835521    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnf5l\" (UniqueName: \"kubernetes.io/projected/15ce9f72-5e7f-42b6-8527-1d8cafe73b23-kube-api-access-mnf5l\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:54:08.366608 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.366572    2558 generic.go:356] "Generic (PLEG): container finished" podID="15ce9f72-5e7f-42b6-8527-1d8cafe73b23" containerID="afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6" exitCode=0
Jul 11 03:54:08.367108 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.366618    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nchkw"
Jul 11 03:54:08.367108 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.366659    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nchkw" event={"ID":"15ce9f72-5e7f-42b6-8527-1d8cafe73b23","Type":"ContainerDied","Data":"afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6"}
Jul 11 03:54:08.367108 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.366709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nchkw" event={"ID":"15ce9f72-5e7f-42b6-8527-1d8cafe73b23","Type":"ContainerDied","Data":"62ddd1f5f00f62c0db5fb0955bf4b2aab43c8c92167e5644b95ac71711502ffb"}
Jul 11 03:54:08.367108 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.366730    2558 scope.go:117] "RemoveContainer" containerID="afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6"
Jul 11 03:54:08.376756 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.376737    2558 scope.go:117] "RemoveContainer" containerID="afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6"
Jul 11 03:54:08.377069 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:54:08.377051    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6\": container with ID starting with afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6 not found: ID does not exist" containerID="afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6"
Jul 11 03:54:08.377125 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.377076    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6"} err="failed to get container status \"afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6\": rpc error: code = NotFound desc = could not find container \"afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6\": container with ID starting with afafc05e6ae408d237c98eadc6b724035ded7dbda2446a1c829eeae13f4178d6 not found: ID does not exist"
Jul 11 03:54:08.387044 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.387009    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nchkw"]
Jul 11 03:54:08.390962 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:08.390943    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nchkw"]
Jul 11 03:54:09.538601 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:09.538560    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ce9f72-5e7f-42b6-8527-1d8cafe73b23" path="/var/lib/kubelet/pods/15ce9f72-5e7f-42b6-8527-1d8cafe73b23/volumes"
Jul 11 03:54:15.046868 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:15.046778    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:15.046868 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:15.046863    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:15.069789 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:15.069763    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:15.420121 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:15.420089    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hnbr8"
Jul 11 03:54:27.566632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:27.566601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:27.666521 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:27.666485    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:28.938635 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:28.938604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:29.935094 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:29.935057    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:33.792537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.792492    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"]
Jul 11 03:54:33.793058 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.793022    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ce9f72-5e7f-42b6-8527-1d8cafe73b23" containerName="registry-server"
Jul 11 03:54:33.793058 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.793043    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ce9f72-5e7f-42b6-8527-1d8cafe73b23" containerName="registry-server"
Jul 11 03:54:33.793171 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.793146    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ce9f72-5e7f-42b6-8527-1d8cafe73b23" containerName="registry-server"
Jul 11 03:54:33.797321 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.797298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"
Jul 11 03:54:33.800217 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.800194    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pzxg2\""
Jul 11 03:54:33.811155 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.811132    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"]
Jul 11 03:54:33.955151 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:33.955117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6kq7\" (UniqueName: \"kubernetes.io/projected/16d1e9ec-11c0-4fcd-859f-dc141be5fea9-kube-api-access-d6kq7\") pod \"authorino-operator-75cc8d5cb7-2g5nc\" (UID: \"16d1e9ec-11c0-4fcd-859f-dc141be5fea9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"
Jul 11 03:54:34.055752 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:34.055658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6kq7\" (UniqueName: \"kubernetes.io/projected/16d1e9ec-11c0-4fcd-859f-dc141be5fea9-kube-api-access-d6kq7\") pod \"authorino-operator-75cc8d5cb7-2g5nc\" (UID: \"16d1e9ec-11c0-4fcd-859f-dc141be5fea9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"
Jul 11 03:54:34.068391 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:34.068357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6kq7\" (UniqueName: \"kubernetes.io/projected/16d1e9ec-11c0-4fcd-859f-dc141be5fea9-kube-api-access-d6kq7\") pod \"authorino-operator-75cc8d5cb7-2g5nc\" (UID: \"16d1e9ec-11c0-4fcd-859f-dc141be5fea9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"
Jul 11 03:54:34.107482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:34.107445    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"
Jul 11 03:54:34.239185 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:34.239164    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"]
Jul 11 03:54:34.241816 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:54:34.241777    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d1e9ec_11c0_4fcd_859f_dc141be5fea9.slice/crio-19cf9735f86a0a21bc3a803562a33c8119a9949c11f38fb92ace0e34928081e9 WatchSource:0}: Error finding container 19cf9735f86a0a21bc3a803562a33c8119a9949c11f38fb92ace0e34928081e9: Status 404 returned error can't find the container with id 19cf9735f86a0a21bc3a803562a33c8119a9949c11f38fb92ace0e34928081e9
Jul 11 03:54:34.481008 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:34.480975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc" event={"ID":"16d1e9ec-11c0-4fcd-859f-dc141be5fea9","Type":"ContainerStarted","Data":"19cf9735f86a0a21bc3a803562a33c8119a9949c11f38fb92ace0e34928081e9"}
Jul 11 03:54:35.557920 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:35.557883    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:37.496126 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.496089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc" event={"ID":"16d1e9ec-11c0-4fcd-859f-dc141be5fea9","Type":"ContainerStarted","Data":"f526d14eb79c44f592ea60708c769e404d44dbd1708343e6fc5b6b8e0db4b675"}
Jul 11 03:54:37.496574 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.496202    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"
Jul 11 03:54:37.514123 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.514070    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc" podStartSLOduration=2.3046893 podStartE2EDuration="4.514054652s" totalImagesPullingTime="2.209365352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:54:37.511400263 +0000 UTC m=+376.595002598" watchObservedRunningTime="2026-07-11 03:54:37.514054652 +0000 UTC m=+376.597656964"
Jul 11 03:54:37.858490 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.858454    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"]
Jul 11 03:54:37.862039 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.862017    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"
Jul 11 03:54:37.864367 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.864344    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 11 03:54:37.864444 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.864407    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pn8cp\""
Jul 11 03:54:37.872609 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.872584    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"]
Jul 11 03:54:37.990854 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:37.990779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9rt\" (UniqueName: \"kubernetes.io/projected/8d97e7fb-475d-485c-aee3-2b9eacf06a5d-kube-api-access-hk9rt\") pod \"dns-operator-controller-manager-864dd78c4c-h7frx\" (UID: \"8d97e7fb-475d-485c-aee3-2b9eacf06a5d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"
Jul 11 03:54:38.092144 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:38.092106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9rt\" (UniqueName: \"kubernetes.io/projected/8d97e7fb-475d-485c-aee3-2b9eacf06a5d-kube-api-access-hk9rt\") pod \"dns-operator-controller-manager-864dd78c4c-h7frx\" (UID: \"8d97e7fb-475d-485c-aee3-2b9eacf06a5d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"
Jul 11 03:54:38.101277 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:38.101240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9rt\" (UniqueName: \"kubernetes.io/projected/8d97e7fb-475d-485c-aee3-2b9eacf06a5d-kube-api-access-hk9rt\") pod \"dns-operator-controller-manager-864dd78c4c-h7frx\" (UID: \"8d97e7fb-475d-485c-aee3-2b9eacf06a5d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"
Jul 11 03:54:38.172471 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:38.172373    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"
Jul 11 03:54:38.313998 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:38.313965    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"]
Jul 11 03:54:38.316459 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:54:38.316430    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d97e7fb_475d_485c_aee3_2b9eacf06a5d.slice/crio-f48b8316751f8dd8b7af6d37087486288c73811b381dd9d67396713fca222d5c WatchSource:0}: Error finding container f48b8316751f8dd8b7af6d37087486288c73811b381dd9d67396713fca222d5c: Status 404 returned error can't find the container with id f48b8316751f8dd8b7af6d37087486288c73811b381dd9d67396713fca222d5c
Jul 11 03:54:38.501612 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:38.501526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx" event={"ID":"8d97e7fb-475d-485c-aee3-2b9eacf06a5d","Type":"ContainerStarted","Data":"f48b8316751f8dd8b7af6d37087486288c73811b381dd9d67396713fca222d5c"}
Jul 11 03:54:39.190351 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:39.190313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:39.341167 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:39.341129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:41.520086 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.520046    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx" event={"ID":"8d97e7fb-475d-485c-aee3-2b9eacf06a5d","Type":"ContainerStarted","Data":"d420cda4fa778f15bb53936a9d6a72319013dfdcbc641838d8e19d01ef93b3a5"}
Jul 11 03:54:41.520486 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.520109    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"
Jul 11 03:54:41.541460 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.541411    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx" podStartSLOduration=2.215514611 podStartE2EDuration="4.54139727s" totalImagesPullingTime="2.325882659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:54:41.539203203 +0000 UTC m=+380.622805542" watchObservedRunningTime="2026-07-11 03:54:41.54139727 +0000 UTC m=+380.624999581"
Jul 11 03:54:41.593578 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.593536    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:41.949771 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.949732    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"]
Jul 11 03:54:41.953320 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.953300    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:54:41.955990 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.955971    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bfqck\""
Jul 11 03:54:41.963299 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:41.963276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"]
Jul 11 03:54:42.123923 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:42.123886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrlnq\" (UniqueName: \"kubernetes.io/projected/1e3b7bcc-5a69-43a5-9dae-3953f33e2a58-kube-api-access-mrlnq\") pod \"limitador-operator-controller-manager-859d7b78bd-tq749\" (UID: \"1e3b7bcc-5a69-43a5-9dae-3953f33e2a58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:54:42.224961 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:42.224874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrlnq\" (UniqueName: \"kubernetes.io/projected/1e3b7bcc-5a69-43a5-9dae-3953f33e2a58-kube-api-access-mrlnq\") pod \"limitador-operator-controller-manager-859d7b78bd-tq749\" (UID: \"1e3b7bcc-5a69-43a5-9dae-3953f33e2a58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:54:42.232309 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:42.232288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrlnq\" (UniqueName: \"kubernetes.io/projected/1e3b7bcc-5a69-43a5-9dae-3953f33e2a58-kube-api-access-mrlnq\") pod \"limitador-operator-controller-manager-859d7b78bd-tq749\" (UID: \"1e3b7bcc-5a69-43a5-9dae-3953f33e2a58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:54:42.263926 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:42.263893    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:54:42.392679 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:42.392653    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"]
Jul 11 03:54:42.395448 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:54:42.395416    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3b7bcc_5a69_43a5_9dae_3953f33e2a58.slice/crio-590dca3e56e1f8b8927594218427f0e7cb25c31e9c6bc0a09f73f205ff1ec524 WatchSource:0}: Error finding container 590dca3e56e1f8b8927594218427f0e7cb25c31e9c6bc0a09f73f205ff1ec524: Status 404 returned error can't find the container with id 590dca3e56e1f8b8927594218427f0e7cb25c31e9c6bc0a09f73f205ff1ec524
Jul 11 03:54:42.526570 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:42.526495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749" event={"ID":"1e3b7bcc-5a69-43a5-9dae-3953f33e2a58","Type":"ContainerStarted","Data":"590dca3e56e1f8b8927594218427f0e7cb25c31e9c6bc0a09f73f205ff1ec524"}
Jul 11 03:54:42.557627 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:42.557594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:43.036401 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:43.036367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:44.536722 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:44.536686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749" event={"ID":"1e3b7bcc-5a69-43a5-9dae-3953f33e2a58","Type":"ContainerStarted","Data":"9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033"}
Jul 11 03:54:44.537142 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:44.536817    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:54:44.569507 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:44.569451    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749" podStartSLOduration=2.077886903 podStartE2EDuration="3.569434932s" totalImagesPullingTime="1.491548029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:54:44.567272918 +0000 UTC m=+383.650875262" watchObservedRunningTime="2026-07-11 03:54:44.569434932 +0000 UTC m=+383.653037244"
Jul 11 03:54:45.572181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:45.572116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:47.901791 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:47.901752    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"]
Jul 11 03:54:47.905282 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:47.905261    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:47.908157 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:47.908134    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mhf9b\""
Jul 11 03:54:47.920459 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:47.920434    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"]
Jul 11 03:54:47.977154 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:47.977118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:47.977154 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:47.977155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmtw9\" (UniqueName: \"kubernetes.io/projected/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-kube-api-access-lmtw9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:48.078081 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.078047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:48.078081 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.078086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmtw9\" (UniqueName: \"kubernetes.io/projected/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-kube-api-access-lmtw9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:48.078432 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.078414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:48.091240 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.091213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmtw9\" (UniqueName: \"kubernetes.io/projected/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-kube-api-access-lmtw9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:48.215837 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.215722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:48.350054 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.349976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"]
Jul 11 03:54:48.352969 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:54:48.352934    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0ddca8_3886_4838_b0c3_f53eaf42e44a.slice/crio-a5bf3c9492ea1e9b55776fd1d89fa1a9d26558523ce2d559794f468fe6a58f19 WatchSource:0}: Error finding container a5bf3c9492ea1e9b55776fd1d89fa1a9d26558523ce2d559794f468fe6a58f19: Status 404 returned error can't find the container with id a5bf3c9492ea1e9b55776fd1d89fa1a9d26558523ce2d559794f468fe6a58f19
Jul 11 03:54:48.503562 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.503476    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2g5nc"
Jul 11 03:54:48.555347 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:48.555312    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z" event={"ID":"9e0ddca8-3886-4838-b0c3-f53eaf42e44a","Type":"ContainerStarted","Data":"a5bf3c9492ea1e9b55776fd1d89fa1a9d26558523ce2d559794f468fe6a58f19"}
Jul 11 03:54:49.949313 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:49.949277    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:50.047211 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:50.047173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:50.345374 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:50.345292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:50.398164 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:50.398129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:52.529388 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:52.529360    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h7frx"
Jul 11 03:54:54.584247 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:54.584213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z" event={"ID":"9e0ddca8-3886-4838-b0c3-f53eaf42e44a","Type":"ContainerStarted","Data":"673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786"}
Jul 11 03:54:54.584744 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:54.584313    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:54:54.603471 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:54.603415    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z" podStartSLOduration=1.9964062409999999 podStartE2EDuration="7.603396931s" totalImagesPullingTime="5.60699069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:54:54.601225543 +0000 UTC m=+393.684827888" watchObservedRunningTime="2026-07-11 03:54:54.603396931 +0000 UTC m=+393.686999242"
Jul 11 03:54:55.542680 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:55.542650    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:54:55.555605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:55.555577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:55.658393 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:55.658361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:56.817612 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:56.817579    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:54:56.917095 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:54:56.917061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:00.346572 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:00.346484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:00.446497 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:00.446457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:03.175894 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:03.175856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:03.235516 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:03.235475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:04.750533 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:04.750494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:04.851376 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:04.851332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:05.126241 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:05.126204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:05.227366 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:05.227326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:05.592385 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:05.592307    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:55:06.654974 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.654940    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"]
Jul 11 03:55:06.663025 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.663001    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:06.671112 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.671086    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"]
Jul 11 03:55:06.744394 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.744360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ab49df-feb3-4701-9023-a12a0a3135cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:06.744580 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.744486    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq48w\" (UniqueName: \"kubernetes.io/projected/75ab49df-feb3-4701-9023-a12a0a3135cc-kube-api-access-kq48w\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:06.845461 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.845419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ab49df-feb3-4701-9023-a12a0a3135cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:06.845657 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.845531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq48w\" (UniqueName: \"kubernetes.io/projected/75ab49df-feb3-4701-9023-a12a0a3135cc-kube-api-access-kq48w\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:06.845839 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.845797    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ab49df-feb3-4701-9023-a12a0a3135cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:06.855975 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.855950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq48w\" (UniqueName: \"kubernetes.io/projected/75ab49df-feb3-4701-9023-a12a0a3135cc-kube-api-access-kq48w\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:06.974830 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:06.974711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:07.113783 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.113758    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"]
Jul 11 03:55:07.115653 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:55:07.115626    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ab49df_feb3_4701_9023_a12a0a3135cc.slice/crio-5205b5f332ca9d6d3dbd469aae17943f89e7899e0b0bf0615fc6f9e6d52ad22a WatchSource:0}: Error finding container 5205b5f332ca9d6d3dbd469aae17943f89e7899e0b0bf0615fc6f9e6d52ad22a: Status 404 returned error can't find the container with id 5205b5f332ca9d6d3dbd469aae17943f89e7899e0b0bf0615fc6f9e6d52ad22a
Jul 11 03:55:07.268159 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.268056    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"]
Jul 11 03:55:07.272265 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.272233    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"]
Jul 11 03:55:07.283361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.283329    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"]
Jul 11 03:55:07.283526 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.283498    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" containerName="manager" containerID="cri-o://673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786" gracePeriod=2
Jul 11 03:55:07.287025 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.286999    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"]
Jul 11 03:55:07.287445 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.287428    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" containerName="manager"
Jul 11 03:55:07.287611 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.287447    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" containerName="manager"
Jul 11 03:55:07.287611 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.287570    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" containerName="manager"
Jul 11 03:55:07.291632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.291582    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.294450 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.294408    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"]
Jul 11 03:55:07.302830 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.302772    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-lw45z\": pods \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:55:07.307653 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.307630    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"]
Jul 11 03:55:07.309822 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.309787    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"]
Jul 11 03:55:07.310286 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.310264    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" containerName="manager"
Jul 11 03:55:07.310286 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.310285    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" containerName="manager"
Jul 11 03:55:07.310460 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.310386    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" containerName="manager"
Jul 11 03:55:07.314115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.313903    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"]
Jul 11 03:55:07.314232 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.314173    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.314344 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.314315    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749" podUID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" containerName="manager" containerID="cri-o://9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033" gracePeriod=2
Jul 11 03:55:07.318595 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.318573    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"]
Jul 11 03:55:07.334265 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.334122    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"]
Jul 11 03:55:07.339445 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.339404    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:55:07.342079 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.342042    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"]
Jul 11 03:55:07.342440 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.342424    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" containerName="manager"
Jul 11 03:55:07.342510 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.342443    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" containerName="manager"
Jul 11 03:55:07.342589 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.342577    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" containerName="manager"
Jul 11 03:55:07.345945 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.345924    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"
Jul 11 03:55:07.350761 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.350734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xcrc\" (UniqueName: \"kubernetes.io/projected/72e4aed6-16f1-4256-b123-c0ff670249ec-kube-api-access-5xcrc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2vrhq\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.350872 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.350771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e4aed6-16f1-4256-b123-c0ff670249ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2vrhq\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.355102 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.355066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"]
Jul 11 03:55:07.364688 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.364657    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tq749\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:55:07.366879 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.366788    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:55:07.369121 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.369096    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tq749\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:55:07.371201 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.371181    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lw45z\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:55:07.451326 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.451288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7114a-2014-48f3-a0eb-128154f305f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjk75\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.451326 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.451337    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwztr\" (UniqueName: \"kubernetes.io/projected/abd7114a-2014-48f3-a0eb-128154f305f0-kube-api-access-pwztr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjk75\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.451585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.451467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsbsv\" (UniqueName: \"kubernetes.io/projected/4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb-kube-api-access-qsbsv\") pod \"limitador-operator-controller-manager-859d7b78bd-nx8dt\" (UID: \"4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"
Jul 11 03:55:07.451585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.451528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xcrc\" (UniqueName: \"kubernetes.io/projected/72e4aed6-16f1-4256-b123-c0ff670249ec-kube-api-access-5xcrc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2vrhq\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.451585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.451565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e4aed6-16f1-4256-b123-c0ff670249ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2vrhq\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.452120 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.452085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e4aed6-16f1-4256-b123-c0ff670249ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2vrhq\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.459967 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.459918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xcrc\" (UniqueName: \"kubernetes.io/projected/72e4aed6-16f1-4256-b123-c0ff670249ec-kube-api-access-5xcrc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2vrhq\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.551531 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.551505    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:55:07.552430 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.552404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7114a-2014-48f3-a0eb-128154f305f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjk75\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.552575 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.552443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwztr\" (UniqueName: \"kubernetes.io/projected/abd7114a-2014-48f3-a0eb-128154f305f0-kube-api-access-pwztr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjk75\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.552575 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.552502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsbsv\" (UniqueName: \"kubernetes.io/projected/4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb-kube-api-access-qsbsv\") pod \"limitador-operator-controller-manager-859d7b78bd-nx8dt\" (UID: \"4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"
Jul 11 03:55:07.552928 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.552905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7114a-2014-48f3-a0eb-128154f305f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjk75\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.569560 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.569524    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsbsv\" (UniqueName: \"kubernetes.io/projected/4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb-kube-api-access-qsbsv\") pod \"limitador-operator-controller-manager-859d7b78bd-nx8dt\" (UID: \"4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"
Jul 11 03:55:07.569560 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.569557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwztr\" (UniqueName: \"kubernetes.io/projected/abd7114a-2014-48f3-a0eb-128154f305f0-kube-api-access-pwztr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjk75\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.586357 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.586335    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:55:07.651661 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.651623    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k" container="manager"
Jul 11 03:55:07.652857 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.652824    2558 generic.go:356] "Generic (PLEG): container finished" podID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" containerID="9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033" exitCode=0
Jul 11 03:55:07.653001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.652859    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tq749"
Jul 11 03:55:07.653001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.652869    2558 scope.go:117] "RemoveContainer" containerID="9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033"
Jul 11 03:55:07.653001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.652832    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmtw9\" (UniqueName: \"kubernetes.io/projected/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-kube-api-access-lmtw9\") pod \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") "
Jul 11 03:55:07.653001 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.652973    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrlnq\" (UniqueName: \"kubernetes.io/projected/1e3b7bcc-5a69-43a5-9dae-3953f33e2a58-kube-api-access-mrlnq\") pod \"1e3b7bcc-5a69-43a5-9dae-3953f33e2a58\" (UID: \"1e3b7bcc-5a69-43a5-9dae-3953f33e2a58\") "
Jul 11 03:55:07.653364 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.653072    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-extensions-socket-volume\") pod \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\" (UID: \"9e0ddca8-3886-4838-b0c3-f53eaf42e44a\") "
Jul 11 03:55:07.653660 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.653624    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e0ddca8-3886-4838-b0c3-f53eaf42e44a" (UID: "9e0ddca8-3886-4838-b0c3-f53eaf42e44a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:55:07.654786 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.654723    2558 generic.go:356] "Generic (PLEG): container finished" podID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" containerID="673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786" exitCode=0
Jul 11 03:55:07.654786 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.654765    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw45z"
Jul 11 03:55:07.655364 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.655339    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-kube-api-access-lmtw9" (OuterVolumeSpecName: "kube-api-access-lmtw9") pod "9e0ddca8-3886-4838-b0c3-f53eaf42e44a" (UID: "9e0ddca8-3886-4838-b0c3-f53eaf42e44a"). InnerVolumeSpecName "kube-api-access-lmtw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:55:07.655447 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.655429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3b7bcc-5a69-43a5-9dae-3953f33e2a58-kube-api-access-mrlnq" (OuterVolumeSpecName: "kube-api-access-mrlnq") pod "1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" (UID: "1e3b7bcc-5a69-43a5-9dae-3953f33e2a58"). InnerVolumeSpecName "kube-api-access-mrlnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:55:07.662430 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.662416    2558 scope.go:117] "RemoveContainer" containerID="9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033"
Jul 11 03:55:07.662704 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.662685    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033\": container with ID starting with 9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033 not found: ID does not exist" containerID="9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033"
Jul 11 03:55:07.662857 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.662715    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033"} err="failed to get container status \"9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033\": rpc error: code = NotFound desc = could not find container \"9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033\": container with ID starting with 9329ccca18b66b0b1a38312a6ca09c2f20cc963c431ddcdcc95b5bda832c2033 not found: ID does not exist"
Jul 11 03:55:07.662857 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.662738    2558 scope.go:117] "RemoveContainer" containerID="673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786"
Jul 11 03:55:07.670718 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.670700    2558 scope.go:117] "RemoveContainer" containerID="673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786"
Jul 11 03:55:07.671023 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:07.671006    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786\": container with ID starting with 673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786 not found: ID does not exist" containerID="673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786"
Jul 11 03:55:07.671093 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.671030    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786"} err="failed to get container status \"673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786\": rpc error: code = NotFound desc = could not find container \"673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786\": container with ID starting with 673048fc84478784842518f52eae0d336bd510041254a0a412c138d5ff4fb786 not found: ID does not exist"
Jul 11 03:55:07.715479 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.715441    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:07.721577 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.721548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:07.728731 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.728701    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"
Jul 11 03:55:07.753824 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.753773    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-extensions-socket-volume\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:07.753824 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.753818    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmtw9\" (UniqueName: \"kubernetes.io/projected/9e0ddca8-3886-4838-b0c3-f53eaf42e44a-kube-api-access-lmtw9\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:07.753824 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.753835    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrlnq\" (UniqueName: \"kubernetes.io/projected/1e3b7bcc-5a69-43a5-9dae-3953f33e2a58-kube-api-access-mrlnq\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:07.878661 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.878579    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"]
Jul 11 03:55:07.879815 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:55:07.879754    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd7114a_2014_48f3_a0eb_128154f305f0.slice/crio-18d3e35b8c0b1abadd4d03f92781e543ee4a60020a7dc44d18f527eaa1920b7b WatchSource:0}: Error finding container 18d3e35b8c0b1abadd4d03f92781e543ee4a60020a7dc44d18f527eaa1920b7b: Status 404 returned error can't find the container with id 18d3e35b8c0b1abadd4d03f92781e543ee4a60020a7dc44d18f527eaa1920b7b
Jul 11 03:55:07.898157 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.898121    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"]
Jul 11 03:55:07.903507 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:55:07.903477    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e4aed6_16f1_4256_b123_c0ff670249ec.slice/crio-916a667b25a3082c14412e8d6eeec6b9f5b29952eaf612c128a67cd51e10ceb1 WatchSource:0}: Error finding container 916a667b25a3082c14412e8d6eeec6b9f5b29952eaf612c128a67cd51e10ceb1: Status 404 returned error can't find the container with id 916a667b25a3082c14412e8d6eeec6b9f5b29952eaf612c128a67cd51e10ceb1
Jul 11 03:55:07.926396 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:07.926370    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"]
Jul 11 03:55:07.932882 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:55:07.932859    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3b6a09_b8b3_43f3_9cac_1db38a09c6fb.slice/crio-dd66b133bf58418a22d132e914cbb2af2274ac4d51163b0d68c1fa20548d94fb WatchSource:0}: Error finding container dd66b133bf58418a22d132e914cbb2af2274ac4d51163b0d68c1fa20548d94fb: Status 404 returned error can't find the container with id dd66b133bf58418a22d132e914cbb2af2274ac4d51163b0d68c1fa20548d94fb
Jul 11 03:55:08.661022 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.660978    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" containerName="manager" containerID="cri-o://5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f" gracePeriod=2
Jul 11 03:55:08.662686 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.662662    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt" event={"ID":"4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb","Type":"ContainerStarted","Data":"c8918325df31a8ee474b730877d910ad3995a2966b43c699851740d610f8037e"}
Jul 11 03:55:08.662819 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.662706    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt" event={"ID":"4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb","Type":"ContainerStarted","Data":"dd66b133bf58418a22d132e914cbb2af2274ac4d51163b0d68c1fa20548d94fb"}
Jul 11 03:55:08.662819 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.662746    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"
Jul 11 03:55:08.663292 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:08.663255    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:08.664369 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.664343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq" event={"ID":"72e4aed6-16f1-4256-b123-c0ff670249ec","Type":"ContainerStarted","Data":"a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a"}
Jul 11 03:55:08.664486 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.664394    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:08.664486 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.664417    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq" event={"ID":"72e4aed6-16f1-4256-b123-c0ff670249ec","Type":"ContainerStarted","Data":"916a667b25a3082c14412e8d6eeec6b9f5b29952eaf612c128a67cd51e10ceb1"}
Jul 11 03:55:08.665537 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:08.665505    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:08.667547 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.667524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75" event={"ID":"abd7114a-2014-48f3-a0eb-128154f305f0","Type":"ContainerStarted","Data":"3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a"}
Jul 11 03:55:08.667625 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.667570    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75" event={"ID":"abd7114a-2014-48f3-a0eb-128154f305f0","Type":"ContainerStarted","Data":"18d3e35b8c0b1abadd4d03f92781e543ee4a60020a7dc44d18f527eaa1920b7b"}
Jul 11 03:55:08.667665 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.667641    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:08.681732 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.681686    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt" podStartSLOduration=1.681673237 podStartE2EDuration="1.681673237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:08.680731095 +0000 UTC m=+407.764333474" watchObservedRunningTime="2026-07-11 03:55:08.681673237 +0000 UTC m=+407.765275549"
Jul 11 03:55:08.698832 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.698768    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq" podStartSLOduration=1.698753634 podStartE2EDuration="1.698753634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:08.697082352 +0000 UTC m=+407.780684693" watchObservedRunningTime="2026-07-11 03:55:08.698753634 +0000 UTC m=+407.782355946"
Jul 11 03:55:08.715360 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.715309    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75" podStartSLOduration=1.715293538 podStartE2EDuration="1.715293538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:08.713533614 +0000 UTC m=+407.797135944" watchObservedRunningTime="2026-07-11 03:55:08.715293538 +0000 UTC m=+407.798895850"
Jul 11 03:55:08.715631 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:08.715592    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:08.906163 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.906132    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:08.908445 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:08.908402    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:08.964156 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.964059    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ab49df-feb3-4701-9023-a12a0a3135cc-extensions-socket-volume\") pod \"75ab49df-feb3-4701-9023-a12a0a3135cc\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") "
Jul 11 03:55:08.964156 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.964118    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq48w\" (UniqueName: \"kubernetes.io/projected/75ab49df-feb3-4701-9023-a12a0a3135cc-kube-api-access-kq48w\") pod \"75ab49df-feb3-4701-9023-a12a0a3135cc\" (UID: \"75ab49df-feb3-4701-9023-a12a0a3135cc\") "
Jul 11 03:55:08.964358 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.964335    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ab49df-feb3-4701-9023-a12a0a3135cc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "75ab49df-feb3-4701-9023-a12a0a3135cc" (UID: "75ab49df-feb3-4701-9023-a12a0a3135cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:55:08.966169 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:08.966142    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ab49df-feb3-4701-9023-a12a0a3135cc-kube-api-access-kq48w" (OuterVolumeSpecName: "kube-api-access-kq48w") pod "75ab49df-feb3-4701-9023-a12a0a3135cc" (UID: "75ab49df-feb3-4701-9023-a12a0a3135cc"). InnerVolumeSpecName "kube-api-access-kq48w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:55:09.065448 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.065409    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ab49df-feb3-4701-9023-a12a0a3135cc-extensions-socket-volume\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:09.065448 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.065440    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq48w\" (UniqueName: \"kubernetes.io/projected/75ab49df-feb3-4701-9023-a12a0a3135cc-kube-api-access-kq48w\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:09.539211 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.539180    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3b7bcc-5a69-43a5-9dae-3953f33e2a58" path="/var/lib/kubelet/pods/1e3b7bcc-5a69-43a5-9dae-3953f33e2a58/volumes"
Jul 11 03:55:09.539544 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.539532    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" path="/var/lib/kubelet/pods/75ab49df-feb3-4701-9023-a12a0a3135cc/volumes"
Jul 11 03:55:09.539865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.539852    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0ddca8-3886-4838-b0c3-f53eaf42e44a" path="/var/lib/kubelet/pods/9e0ddca8-3886-4838-b0c3-f53eaf42e44a/volumes"
Jul 11 03:55:09.674881 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.674847    2558 generic.go:356] "Generic (PLEG): container finished" podID="75ab49df-feb3-4701-9023-a12a0a3135cc" containerID="5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f" exitCode=2
Jul 11 03:55:09.675336 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.674890    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:09.675336 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.674938    2558 scope.go:117] "RemoveContainer" containerID="5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f"
Jul 11 03:55:09.679335 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:09.679308    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:09.683890 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.683874    2558 scope.go:117] "RemoveContainer" containerID="5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f"
Jul 11 03:55:09.684162 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:09.684144    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f\": container with ID starting with 5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f not found: ID does not exist" containerID="5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f"
Jul 11 03:55:09.684210 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:09.684171    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f"} err="failed to get container status \"5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f\": rpc error: code = NotFound desc = could not find container \"5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f\": container with ID starting with 5afc1f9536d49c8b36ec88b349c093652fbbdb66708e7735f3f40894e021ea5f not found: ID does not exist"
Jul 11 03:55:11.537198 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:11.537155    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g276k\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="75ab49df-feb3-4701-9023-a12a0a3135cc" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g276k"
Jul 11 03:55:12.348225 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:12.348189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:12.400122 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:12.400078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:12.746158 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:12.746061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:12.847320 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:12.847287    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:16.356202 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:16.356161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:16.452351 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:16.452301    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:18.389313 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:18.389281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:18.443739 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:18.443705    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:19.677124 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.677093    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:19.677601 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.677168    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nx8dt"
Jul 11 03:55:19.677601 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.677323    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:19.758925 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.758890    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"]
Jul 11 03:55:19.759105 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.759064    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75" podUID="abd7114a-2014-48f3-a0eb-128154f305f0" containerName="manager" containerID="cri-o://3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a" gracePeriod=10
Jul 11 03:55:19.966315 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.966287    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"]
Jul 11 03:55:19.970790 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.970767    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:19.981614 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:19.981585    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"]
Jul 11 03:55:20.019041 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.019014    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:20.054628 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.054599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9tk\" (UniqueName: \"kubernetes.io/projected/25646b46-80c5-41f0-a8d6-8db0147b7ffc-kube-api-access-sx9tk\") pod \"kuadrant-operator-controller-manager-86878c769f-tfr8h\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.054780 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.054637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25646b46-80c5-41f0-a8d6-8db0147b7ffc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tfr8h\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.155763 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.155730    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7114a-2014-48f3-a0eb-128154f305f0-extensions-socket-volume\") pod \"abd7114a-2014-48f3-a0eb-128154f305f0\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") "
Jul 11 03:55:20.155960 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.155856    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwztr\" (UniqueName: \"kubernetes.io/projected/abd7114a-2014-48f3-a0eb-128154f305f0-kube-api-access-pwztr\") pod \"abd7114a-2014-48f3-a0eb-128154f305f0\" (UID: \"abd7114a-2014-48f3-a0eb-128154f305f0\") "
Jul 11 03:55:20.156052 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.156028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25646b46-80c5-41f0-a8d6-8db0147b7ffc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tfr8h\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.156215 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.156187    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abd7114a-2014-48f3-a0eb-128154f305f0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "abd7114a-2014-48f3-a0eb-128154f305f0" (UID: "abd7114a-2014-48f3-a0eb-128154f305f0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:55:20.156215 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.156199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9tk\" (UniqueName: \"kubernetes.io/projected/25646b46-80c5-41f0-a8d6-8db0147b7ffc-kube-api-access-sx9tk\") pod \"kuadrant-operator-controller-manager-86878c769f-tfr8h\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.156381 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.156248    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abd7114a-2014-48f3-a0eb-128154f305f0-extensions-socket-volume\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:20.156381 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.156365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25646b46-80c5-41f0-a8d6-8db0147b7ffc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tfr8h\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.157869 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.157844    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd7114a-2014-48f3-a0eb-128154f305f0-kube-api-access-pwztr" (OuterVolumeSpecName: "kube-api-access-pwztr") pod "abd7114a-2014-48f3-a0eb-128154f305f0" (UID: "abd7114a-2014-48f3-a0eb-128154f305f0"). InnerVolumeSpecName "kube-api-access-pwztr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:55:20.164523 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.164502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9tk\" (UniqueName: \"kubernetes.io/projected/25646b46-80c5-41f0-a8d6-8db0147b7ffc-kube-api-access-sx9tk\") pod \"kuadrant-operator-controller-manager-86878c769f-tfr8h\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.257332 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.257250    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwztr\" (UniqueName: \"kubernetes.io/projected/abd7114a-2014-48f3-a0eb-128154f305f0-kube-api-access-pwztr\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:20.281313 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.281284    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.359217 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.359179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:20.427847 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.426501    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"]
Jul 11 03:55:20.464702 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.464674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:20.734501 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.734464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h" event={"ID":"25646b46-80c5-41f0-a8d6-8db0147b7ffc","Type":"ContainerStarted","Data":"1247c2abfe6459b7613f517e0b4f1b2c50ef2b4411788b2701e27157cdde551f"}
Jul 11 03:55:20.734941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.734525    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:20.734941 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.734542    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h" event={"ID":"25646b46-80c5-41f0-a8d6-8db0147b7ffc","Type":"ContainerStarted","Data":"f8476cf4ef9e6b766b86820e7d4e1172046b771e5524ffb489b9e23e0c342c9b"}
Jul 11 03:55:20.735828 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.735783    2558 generic.go:356] "Generic (PLEG): container finished" podID="abd7114a-2014-48f3-a0eb-128154f305f0" containerID="3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a" exitCode=0
Jul 11 03:55:20.735944 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.735829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75" event={"ID":"abd7114a-2014-48f3-a0eb-128154f305f0","Type":"ContainerDied","Data":"3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a"}
Jul 11 03:55:20.735944 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.735849    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"
Jul 11 03:55:20.735944 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.735877    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75" event={"ID":"abd7114a-2014-48f3-a0eb-128154f305f0","Type":"ContainerDied","Data":"18d3e35b8c0b1abadd4d03f92781e543ee4a60020a7dc44d18f527eaa1920b7b"}
Jul 11 03:55:20.735944 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.735899    2558 scope.go:117] "RemoveContainer" containerID="3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a"
Jul 11 03:55:20.745208 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.745190    2558 scope.go:117] "RemoveContainer" containerID="3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a"
Jul 11 03:55:20.745452 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:20.745434    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a\": container with ID starting with 3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a not found: ID does not exist" containerID="3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a"
Jul 11 03:55:20.745498 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.745461    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a"} err="failed to get container status \"3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a\": rpc error: code = NotFound desc = could not find container \"3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a\": container with ID starting with 3242a584e3d28fcb2114b5d134aaeadad814a6fef8062d6bb44f3ade054b1c6a not found: ID does not exist"
Jul 11 03:55:20.766851 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.766791    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h" podStartSLOduration=1.766777147 podStartE2EDuration="1.766777147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:20.765306587 +0000 UTC m=+419.848908929" watchObservedRunningTime="2026-07-11 03:55:20.766777147 +0000 UTC m=+419.850379460"
Jul 11 03:55:20.789197 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.789161    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"]
Jul 11 03:55:20.794302 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:20.794280    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjk75"]
Jul 11 03:55:21.243820 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:21.243774    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:21.539030 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:21.539002    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abd7114a-2014-48f3-a0eb-128154f305f0" path="/var/lib/kubelet/pods/abd7114a-2014-48f3-a0eb-128154f305f0/volumes"
Jul 11 03:55:23.757098 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:23.757067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:23.856294 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:23.856259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:29.497567 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:29.497532    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:29.597949 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:29.597907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:29.649417 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:29.649380    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:31.743789 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:31.743756    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 03:55:31.793272 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:31.793237    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"]
Jul 11 03:55:31.793478 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:31.793451    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq" podUID="72e4aed6-16f1-4256-b123-c0ff670249ec" containerName="manager" containerID="cri-o://a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a" gracePeriod=10
Jul 11 03:55:32.058354 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.058331    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:32.168423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.168381    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xcrc\" (UniqueName: \"kubernetes.io/projected/72e4aed6-16f1-4256-b123-c0ff670249ec-kube-api-access-5xcrc\") pod \"72e4aed6-16f1-4256-b123-c0ff670249ec\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") "
Jul 11 03:55:32.168603 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.168498    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e4aed6-16f1-4256-b123-c0ff670249ec-extensions-socket-volume\") pod \"72e4aed6-16f1-4256-b123-c0ff670249ec\" (UID: \"72e4aed6-16f1-4256-b123-c0ff670249ec\") "
Jul 11 03:55:32.168898 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.168875    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e4aed6-16f1-4256-b123-c0ff670249ec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72e4aed6-16f1-4256-b123-c0ff670249ec" (UID: "72e4aed6-16f1-4256-b123-c0ff670249ec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:55:32.170434 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.170414    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e4aed6-16f1-4256-b123-c0ff670249ec-kube-api-access-5xcrc" (OuterVolumeSpecName: "kube-api-access-5xcrc") pod "72e4aed6-16f1-4256-b123-c0ff670249ec" (UID: "72e4aed6-16f1-4256-b123-c0ff670249ec"). InnerVolumeSpecName "kube-api-access-5xcrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:55:32.269721 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.269682    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e4aed6-16f1-4256-b123-c0ff670249ec-extensions-socket-volume\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:32.269721 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.269712    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xcrc\" (UniqueName: \"kubernetes.io/projected/72e4aed6-16f1-4256-b123-c0ff670249ec-kube-api-access-5xcrc\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:32.798068 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.798034    2558 generic.go:356] "Generic (PLEG): container finished" podID="72e4aed6-16f1-4256-b123-c0ff670249ec" containerID="a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a" exitCode=0
Jul 11 03:55:32.798495 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.798077    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"
Jul 11 03:55:32.798495 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.798115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq" event={"ID":"72e4aed6-16f1-4256-b123-c0ff670249ec","Type":"ContainerDied","Data":"a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a"}
Jul 11 03:55:32.798495 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.798169    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq" event={"ID":"72e4aed6-16f1-4256-b123-c0ff670249ec","Type":"ContainerDied","Data":"916a667b25a3082c14412e8d6eeec6b9f5b29952eaf612c128a67cd51e10ceb1"}
Jul 11 03:55:32.798495 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.798194    2558 scope.go:117] "RemoveContainer" containerID="a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a"
Jul 11 03:55:32.807112 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.807091    2558 scope.go:117] "RemoveContainer" containerID="a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a"
Jul 11 03:55:32.807383 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:32.807365    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a\": container with ID starting with a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a not found: ID does not exist" containerID="a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a"
Jul 11 03:55:32.807447 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.807389    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a"} err="failed to get container status \"a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a\": rpc error: code = NotFound desc = could not find container \"a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a\": container with ID starting with a0953836164d06e9927eb7386ed2fd9c7effe10971ac0f810bfc19506c7afb5a not found: ID does not exist"
Jul 11 03:55:32.822207 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.822175    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"]
Jul 11 03:55:32.825744 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:32.825720    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2vrhq"]
Jul 11 03:55:33.538146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:33.538112    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e4aed6-16f1-4256-b123-c0ff670249ec" path="/var/lib/kubelet/pods/72e4aed6-16f1-4256-b123-c0ff670249ec/volumes"
Jul 11 03:55:36.045698 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.045660    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"]
Jul 11 03:55:36.046203 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.046033    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd7114a-2014-48f3-a0eb-128154f305f0" containerName="manager"
Jul 11 03:55:36.046203 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.046044    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd7114a-2014-48f3-a0eb-128154f305f0" containerName="manager"
Jul 11 03:55:36.046203 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.046056    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e4aed6-16f1-4256-b123-c0ff670249ec" containerName="manager"
Jul 11 03:55:36.046203 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.046062    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e4aed6-16f1-4256-b123-c0ff670249ec" containerName="manager"
Jul 11 03:55:36.046203 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.046131    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="abd7114a-2014-48f3-a0eb-128154f305f0" containerName="manager"
Jul 11 03:55:36.046203 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.046140    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e4aed6-16f1-4256-b123-c0ff670249ec" containerName="manager"
Jul 11 03:55:36.050408 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.050385    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.052845 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.052823    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rvt52\""
Jul 11 03:55:36.061450 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.061427    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"]
Jul 11 03:55:36.071737 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.071685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:36.205156 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205214    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205361 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-245j9\" (UniqueName: \"kubernetes.io/projected/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-kube-api-access-245j9\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205579 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205579 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.205579 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.205466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.305954 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.305867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-245j9\" (UniqueName: \"kubernetes.io/projected/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-kube-api-access-245j9\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.305954 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.305913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306196 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306196 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306196 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306355 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306355 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306355 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306355 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306355 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306612 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306669 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306669 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.306958 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.306934    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.308482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.308464    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.308630 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.308609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.313435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.313409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.313564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.313545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-245j9\" (UniqueName: \"kubernetes.io/projected/a5e202f9-7f6a-427c-9fad-dbb1f1daf717-kube-api-access-245j9\") pod \"maas-default-gateway-openshift-default-56654dcf7-7xft6\" (UID: \"a5e202f9-7f6a-427c-9fad-dbb1f1daf717\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.322006 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.321978    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:36.361906 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.361869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:36.502719 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.502691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"]
Jul 11 03:55:36.505444 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:55:36.505409    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e202f9_7f6a_427c_9fad_dbb1f1daf717.slice/crio-a4726a54cc80b37ec85695179076da5cff693895a42abe1efa809a2e7d3e248c WatchSource:0}: Error finding container a4726a54cc80b37ec85695179076da5cff693895a42abe1efa809a2e7d3e248c: Status 404 returned error can't find the container with id a4726a54cc80b37ec85695179076da5cff693895a42abe1efa809a2e7d3e248c
Jul 11 03:55:36.507457 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.507424    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:55:36.507541 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.507498    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:55:36.507541 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.507527    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:55:36.819764 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.819659    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" event={"ID":"a5e202f9-7f6a-427c-9fad-dbb1f1daf717","Type":"ContainerStarted","Data":"8d6b38558f0b943e73715d352d56880d41f4c9fb5d4b06fa70e0a1d6e1cc7d99"}
Jul 11 03:55:36.819764 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.819719    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" event={"ID":"a5e202f9-7f6a-427c-9fad-dbb1f1daf717","Type":"ContainerStarted","Data":"a4726a54cc80b37ec85695179076da5cff693895a42abe1efa809a2e7d3e248c"}
Jul 11 03:55:36.839770 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:36.839718    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" podStartSLOduration=0.839703691 podStartE2EDuration="839.703691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:36.838064545 +0000 UTC m=+435.921666885" watchObservedRunningTime="2026-07-11 03:55:36.839703691 +0000 UTC m=+435.923306002"
Jul 11 03:55:37.362747 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:37.362707    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:37.367579 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:37.367555    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:37.824715 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:37.824635    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:37.825604 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:37.825587    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:55:51.340674 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:51.340594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:51.454385 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:51.454337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:51.504682 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:51.504649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:52.130875 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.130841    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mbtqj"]
Jul 11 03:55:52.136587 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.136553    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mbtqj"
Jul 11 03:55:52.140569 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.140532    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mbtqj"]
Jul 11 03:55:52.141110 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.141083    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9nlfg\""
Jul 11 03:55:52.166062 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.166028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:52.242275 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.242242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xll74\" (UniqueName: \"kubernetes.io/projected/a4f8c830-bad5-42e0-be30-7f879713d691-kube-api-access-xll74\") pod \"authorino-58cd955675-mbtqj\" (UID: \"a4f8c830-bad5-42e0-be30-7f879713d691\") " pod="kuadrant-system/authorino-58cd955675-mbtqj"
Jul 11 03:55:52.244780 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.244750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:55:52.248673 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.248646    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mbrw6"]
Jul 11 03:55:52.252102 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.252083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mbrw6"
Jul 11 03:55:52.258242 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.258214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mbrw6"]
Jul 11 03:55:52.343701 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.343665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xll74\" (UniqueName: \"kubernetes.io/projected/a4f8c830-bad5-42e0-be30-7f879713d691-kube-api-access-xll74\") pod \"authorino-58cd955675-mbtqj\" (UID: \"a4f8c830-bad5-42e0-be30-7f879713d691\") " pod="kuadrant-system/authorino-58cd955675-mbtqj"
Jul 11 03:55:52.344126 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.343724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx28h\" (UniqueName: \"kubernetes.io/projected/da9b6a07-f617-4eb8-a0bd-6c2e4d425240-kube-api-access-tx28h\") pod \"authorino-75d556bd77-mbrw6\" (UID: \"da9b6a07-f617-4eb8-a0bd-6c2e4d425240\") " pod="kuadrant-system/authorino-75d556bd77-mbrw6"
Jul 11 03:55:52.351324 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.351300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xll74\" (UniqueName: \"kubernetes.io/projected/a4f8c830-bad5-42e0-be30-7f879713d691-kube-api-access-xll74\") pod \"authorino-58cd955675-mbtqj\" (UID: \"a4f8c830-bad5-42e0-be30-7f879713d691\") " pod="kuadrant-system/authorino-58cd955675-mbtqj"
Jul 11 03:55:52.444864 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.444759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx28h\" (UniqueName: \"kubernetes.io/projected/da9b6a07-f617-4eb8-a0bd-6c2e4d425240-kube-api-access-tx28h\") pod \"authorino-75d556bd77-mbrw6\" (UID: \"da9b6a07-f617-4eb8-a0bd-6c2e4d425240\") " pod="kuadrant-system/authorino-75d556bd77-mbrw6"
Jul 11 03:55:52.448594 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.448572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mbtqj"
Jul 11 03:55:52.451884 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.451863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx28h\" (UniqueName: \"kubernetes.io/projected/da9b6a07-f617-4eb8-a0bd-6c2e4d425240-kube-api-access-tx28h\") pod \"authorino-75d556bd77-mbrw6\" (UID: \"da9b6a07-f617-4eb8-a0bd-6c2e4d425240\") " pod="kuadrant-system/authorino-75d556bd77-mbrw6"
Jul 11 03:55:52.562157 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.562123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mbrw6"
Jul 11 03:55:52.584587 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.584532    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mbtqj"]
Jul 11 03:55:52.586690 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:55:52.586661    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4f8c830_bad5_42e0_be30_7f879713d691.slice/crio-c020263ccea010df2555f7c8dc6db5d10b84b35694fcaa59b1b9c4851fb2689d WatchSource:0}: Error finding container c020263ccea010df2555f7c8dc6db5d10b84b35694fcaa59b1b9c4851fb2689d: Status 404 returned error can't find the container with id c020263ccea010df2555f7c8dc6db5d10b84b35694fcaa59b1b9c4851fb2689d
Jul 11 03:55:52.699996 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.699971    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mbrw6"]
Jul 11 03:55:52.702073 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:55:52.702051    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda9b6a07_f617_4eb8_a0bd_6c2e4d425240.slice/crio-0e673b622c7703e0f1d2152fe1d0ce982990533c00903df539c7bb6016e9cb4a WatchSource:0}: Error finding container 0e673b622c7703e0f1d2152fe1d0ce982990533c00903df539c7bb6016e9cb4a: Status 404 returned error can't find the container with id 0e673b622c7703e0f1d2152fe1d0ce982990533c00903df539c7bb6016e9cb4a
Jul 11 03:55:52.903913 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.903866    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mbrw6" event={"ID":"da9b6a07-f617-4eb8-a0bd-6c2e4d425240","Type":"ContainerStarted","Data":"0e673b622c7703e0f1d2152fe1d0ce982990533c00903df539c7bb6016e9cb4a"}
Jul 11 03:55:52.905132 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:52.905101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mbtqj" event={"ID":"a4f8c830-bad5-42e0-be30-7f879713d691","Type":"ContainerStarted","Data":"c020263ccea010df2555f7c8dc6db5d10b84b35694fcaa59b1b9c4851fb2689d"}
Jul 11 03:55:56.933737 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:56.933699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mbrw6" event={"ID":"da9b6a07-f617-4eb8-a0bd-6c2e4d425240","Type":"ContainerStarted","Data":"d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f"}
Jul 11 03:55:56.935237 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:56.935209    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mbtqj" event={"ID":"a4f8c830-bad5-42e0-be30-7f879713d691","Type":"ContainerStarted","Data":"d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b"}
Jul 11 03:55:56.947183 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:56.947134    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mbrw6" podStartSLOduration=1.613525443 podStartE2EDuration="4.947118959s" totalImagesPullingTime="3.333593516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:56.946306897 +0000 UTC m=+456.029909240" watchObservedRunningTime="2026-07-11 03:55:56.947118959 +0000 UTC m=+456.030721271"
Jul 11 03:55:56.960404 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:56.960351    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mbtqj" podStartSLOduration=1.5252279770000001 podStartE2EDuration="4.960331255s" totalImagesPullingTime="3.435103278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:56.958491698 +0000 UTC m=+456.042094036" watchObservedRunningTime="2026-07-11 03:55:56.960331255 +0000 UTC m=+456.043933568"
Jul 11 03:55:56.981023 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:56.980990    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mbtqj"]
Jul 11 03:55:58.945780 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:58.945739    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mbtqj" podUID="a4f8c830-bad5-42e0-be30-7f879713d691" containerName="authorino" containerID="cri-o://d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b" gracePeriod=30
Jul 11 03:55:59.196365 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.196301    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mbtqj"
Jul 11 03:55:59.315760 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.315714    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xll74\" (UniqueName: \"kubernetes.io/projected/a4f8c830-bad5-42e0-be30-7f879713d691-kube-api-access-xll74\") pod \"a4f8c830-bad5-42e0-be30-7f879713d691\" (UID: \"a4f8c830-bad5-42e0-be30-7f879713d691\") "
Jul 11 03:55:59.317788 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.317765    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f8c830-bad5-42e0-be30-7f879713d691-kube-api-access-xll74" (OuterVolumeSpecName: "kube-api-access-xll74") pod "a4f8c830-bad5-42e0-be30-7f879713d691" (UID: "a4f8c830-bad5-42e0-be30-7f879713d691"). InnerVolumeSpecName "kube-api-access-xll74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:55:59.417084 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.417045    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xll74\" (UniqueName: \"kubernetes.io/projected/a4f8c830-bad5-42e0-be30-7f879713d691-kube-api-access-xll74\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:55:59.952024 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.951987    2558 generic.go:356] "Generic (PLEG): container finished" podID="a4f8c830-bad5-42e0-be30-7f879713d691" containerID="d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b" exitCode=0
Jul 11 03:55:59.952412 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.952029    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mbtqj"
Jul 11 03:55:59.952412 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.952075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mbtqj" event={"ID":"a4f8c830-bad5-42e0-be30-7f879713d691","Type":"ContainerDied","Data":"d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b"}
Jul 11 03:55:59.952412 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.952114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mbtqj" event={"ID":"a4f8c830-bad5-42e0-be30-7f879713d691","Type":"ContainerDied","Data":"c020263ccea010df2555f7c8dc6db5d10b84b35694fcaa59b1b9c4851fb2689d"}
Jul 11 03:55:59.952412 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.952134    2558 scope.go:117] "RemoveContainer" containerID="d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b"
Jul 11 03:55:59.960770 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.960753    2558 scope.go:117] "RemoveContainer" containerID="d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b"
Jul 11 03:55:59.961047 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:55:59.961026    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b\": container with ID starting with d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b not found: ID does not exist" containerID="d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b"
Jul 11 03:55:59.961121 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.961053    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b"} err="failed to get container status \"d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b\": rpc error: code = NotFound desc = could not find container \"d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b\": container with ID starting with d52601debe40d04f9d68c9deb3ac28fed1a556e64cb32692e86209c25854806b not found: ID does not exist"
Jul 11 03:55:59.966713 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.966682    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mbtqj"]
Jul 11 03:55:59.970117 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:55:59.970097    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mbtqj"]
Jul 11 03:56:01.538531 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:01.538494    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f8c830-bad5-42e0-be30-7f879713d691" path="/var/lib/kubelet/pods/a4f8c830-bad5-42e0-be30-7f879713d691/volumes"
Jul 11 03:56:09.331988 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:09.331945    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:09.432527 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:09.432490    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:09.800351 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:09.800319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:21.835521 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:21.835427    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:21.966695 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:21.966660    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:22.290993 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.290950    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:22.316653 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.316623    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fd6f547c4-6w5dq"]
Jul 11 03:56:22.317040 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.317024    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f8c830-bad5-42e0-be30-7f879713d691" containerName="authorino"
Jul 11 03:56:22.317040 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.317040    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f8c830-bad5-42e0-be30-7f879713d691" containerName="authorino"
Jul 11 03:56:22.317159 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.317126    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f8c830-bad5-42e0-be30-7f879713d691" containerName="authorino"
Jul 11 03:56:22.323859 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.323837    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd6f547c4-6w5dq"
Jul 11 03:56:22.325552 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.325528    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd6f547c4-6w5dq"]
Jul 11 03:56:22.347787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.347753    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:22.404053 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.404017    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd6f547c4-6w5dq"]
Jul 11 03:56:22.404317 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:56:22.404298    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xxzjv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-fd6f547c4-6w5dq" podUID="3816fd63-ee57-4321-b6d5-68ecdf581365"
Jul 11 03:56:22.430396 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.430359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzjv\" (UniqueName: \"kubernetes.io/projected/3816fd63-ee57-4321-b6d5-68ecdf581365-kube-api-access-xxzjv\") pod \"authorino-fd6f547c4-6w5dq\" (UID: \"3816fd63-ee57-4321-b6d5-68ecdf581365\") " pod="kuadrant-system/authorino-fd6f547c4-6w5dq"
Jul 11 03:56:22.531403 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.531372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzjv\" (UniqueName: \"kubernetes.io/projected/3816fd63-ee57-4321-b6d5-68ecdf581365-kube-api-access-xxzjv\") pod \"authorino-fd6f547c4-6w5dq\" (UID: \"3816fd63-ee57-4321-b6d5-68ecdf581365\") " pod="kuadrant-system/authorino-fd6f547c4-6w5dq"
Jul 11 03:56:22.539325 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:22.539297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzjv\" (UniqueName: \"kubernetes.io/projected/3816fd63-ee57-4321-b6d5-68ecdf581365-kube-api-access-xxzjv\") pod \"authorino-fd6f547c4-6w5dq\" (UID: \"3816fd63-ee57-4321-b6d5-68ecdf581365\") " pod="kuadrant-system/authorino-fd6f547c4-6w5dq"
Jul 11 03:56:23.065862 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:23.065827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd6f547c4-6w5dq"
Jul 11 03:56:23.073268 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:23.073241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd6f547c4-6w5dq"
Jul 11 03:56:23.238768 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:23.238728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxzjv\" (UniqueName: \"kubernetes.io/projected/3816fd63-ee57-4321-b6d5-68ecdf581365-kube-api-access-xxzjv\") pod \"3816fd63-ee57-4321-b6d5-68ecdf581365\" (UID: \"3816fd63-ee57-4321-b6d5-68ecdf581365\") "
Jul 11 03:56:23.240892 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:23.240861    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3816fd63-ee57-4321-b6d5-68ecdf581365-kube-api-access-xxzjv" (OuterVolumeSpecName: "kube-api-access-xxzjv") pod "3816fd63-ee57-4321-b6d5-68ecdf581365" (UID: "3816fd63-ee57-4321-b6d5-68ecdf581365"). InnerVolumeSpecName "kube-api-access-xxzjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:56:23.340095 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:23.340016    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxzjv\" (UniqueName: \"kubernetes.io/projected/3816fd63-ee57-4321-b6d5-68ecdf581365-kube-api-access-xxzjv\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:56:24.070997 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:24.070965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd6f547c4-6w5dq"
Jul 11 03:56:24.097760 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:24.097730    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd6f547c4-6w5dq"]
Jul 11 03:56:24.099422 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:24.099396    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fd6f547c4-6w5dq"]
Jul 11 03:56:25.538504 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:25.538467    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3816fd63-ee57-4321-b6d5-68ecdf581365" path="/var/lib/kubelet/pods/3816fd63-ee57-4321-b6d5-68ecdf581365/volumes"
Jul 11 03:56:26.456917 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:26.456882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:26.557766 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:26.557718    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:26.595605 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:26.595565    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mbrw6"]
Jul 11 03:56:26.595851 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:26.595822    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mbrw6" podUID="da9b6a07-f617-4eb8-a0bd-6c2e4d425240" containerName="authorino" containerID="cri-o://d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f" gracePeriod=30
Jul 11 03:56:26.871020 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:26.870992    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mbrw6"
Jul 11 03:56:27.072636 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.072543    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx28h\" (UniqueName: \"kubernetes.io/projected/da9b6a07-f617-4eb8-a0bd-6c2e4d425240-kube-api-access-tx28h\") pod \"da9b6a07-f617-4eb8-a0bd-6c2e4d425240\" (UID: \"da9b6a07-f617-4eb8-a0bd-6c2e4d425240\") "
Jul 11 03:56:27.074604 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.074576    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da9b6a07-f617-4eb8-a0bd-6c2e4d425240-kube-api-access-tx28h" (OuterVolumeSpecName: "kube-api-access-tx28h") pod "da9b6a07-f617-4eb8-a0bd-6c2e4d425240" (UID: "da9b6a07-f617-4eb8-a0bd-6c2e4d425240"). InnerVolumeSpecName "kube-api-access-tx28h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:56:27.085845 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.085788    2558 generic.go:356] "Generic (PLEG): container finished" podID="da9b6a07-f617-4eb8-a0bd-6c2e4d425240" containerID="d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f" exitCode=0
Jul 11 03:56:27.085845 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.085843    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mbrw6"
Jul 11 03:56:27.086008 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.085849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mbrw6" event={"ID":"da9b6a07-f617-4eb8-a0bd-6c2e4d425240","Type":"ContainerDied","Data":"d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f"}
Jul 11 03:56:27.086008 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.085896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mbrw6" event={"ID":"da9b6a07-f617-4eb8-a0bd-6c2e4d425240","Type":"ContainerDied","Data":"0e673b622c7703e0f1d2152fe1d0ce982990533c00903df539c7bb6016e9cb4a"}
Jul 11 03:56:27.086008 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.085915    2558 scope.go:117] "RemoveContainer" containerID="d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f"
Jul 11 03:56:27.094930 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.094909    2558 scope.go:117] "RemoveContainer" containerID="d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f"
Jul 11 03:56:27.095196 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:56:27.095177    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f\": container with ID starting with d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f not found: ID does not exist" containerID="d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f"
Jul 11 03:56:27.095238 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.095205    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f"} err="failed to get container status \"d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f\": rpc error: code = NotFound desc = could not find container \"d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f\": container with ID starting with d9d1d98c1972954ba5c4434dbe063d5ba2d78160390271a59472e50d0159f60f not found: ID does not exist"
Jul 11 03:56:27.105296 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.105275    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mbrw6"]
Jul 11 03:56:27.109217 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.109197    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mbrw6"]
Jul 11 03:56:27.173241 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.173209    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx28h\" (UniqueName: \"kubernetes.io/projected/da9b6a07-f617-4eb8-a0bd-6c2e4d425240-kube-api-access-tx28h\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:56:27.538938 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:27.538903    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da9b6a07-f617-4eb8-a0bd-6c2e4d425240" path="/var/lib/kubelet/pods/da9b6a07-f617-4eb8-a0bd-6c2e4d425240/volumes"
Jul 11 03:56:31.144585 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.144541    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:31.165238 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.165197    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fd846d64d-7ccj5"]
Jul 11 03:56:31.165654 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.165640    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da9b6a07-f617-4eb8-a0bd-6c2e4d425240" containerName="authorino"
Jul 11 03:56:31.165712 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.165657    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="da9b6a07-f617-4eb8-a0bd-6c2e4d425240" containerName="authorino"
Jul 11 03:56:31.165748 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.165734    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="da9b6a07-f617-4eb8-a0bd-6c2e4d425240" containerName="authorino"
Jul 11 03:56:31.171023 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.170996    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.174727 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.174700    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 11 03:56:31.174727 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.174719    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 11 03:56:31.174946 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.174717    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rm24q\""
Jul 11 03:56:31.179146 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.179110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd846d64d-7ccj5"]
Jul 11 03:56:31.209056 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.209018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lpxc\" (UniqueName: \"kubernetes.io/projected/b50cd6d3-c8f1-4141-9609-fa86465217fd-kube-api-access-2lpxc\") pod \"maas-controller-5fd846d64d-7ccj5\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") " pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.209056 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.209069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b50cd6d3-c8f1-4141-9609-fa86465217fd-webhook-cert\") pod \"maas-controller-5fd846d64d-7ccj5\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") " pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.240407 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.240373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:31.301344 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.301305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:31.310332 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.310301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b50cd6d3-c8f1-4141-9609-fa86465217fd-webhook-cert\") pod \"maas-controller-5fd846d64d-7ccj5\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") " pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.310514 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.310391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lpxc\" (UniqueName: \"kubernetes.io/projected/b50cd6d3-c8f1-4141-9609-fa86465217fd-kube-api-access-2lpxc\") pod \"maas-controller-5fd846d64d-7ccj5\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") " pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.313063 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.313034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b50cd6d3-c8f1-4141-9609-fa86465217fd-webhook-cert\") pod \"maas-controller-5fd846d64d-7ccj5\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") " pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.319091 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.319068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lpxc\" (UniqueName: \"kubernetes.io/projected/b50cd6d3-c8f1-4141-9609-fa86465217fd-kube-api-access-2lpxc\") pod \"maas-controller-5fd846d64d-7ccj5\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") " pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.337773 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.337740    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5476cb467b-6hwpd"]
Jul 11 03:56:31.341340 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.341320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.351445 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.351423    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5476cb467b-6hwpd"]
Jul 11 03:56:31.411219 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.411121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-webhook-cert\") pod \"maas-controller-5476cb467b-6hwpd\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") " pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.411219 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.411178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2f8\" (UniqueName: \"kubernetes.io/projected/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-kube-api-access-xz2f8\") pod \"maas-controller-5476cb467b-6hwpd\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") " pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.483342 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.483309    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:31.511677 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.511648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-webhook-cert\") pod \"maas-controller-5476cb467b-6hwpd\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") " pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.511881 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.511706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2f8\" (UniqueName: \"kubernetes.io/projected/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-kube-api-access-xz2f8\") pod \"maas-controller-5476cb467b-6hwpd\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") " pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.514019 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.513995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-webhook-cert\") pod \"maas-controller-5476cb467b-6hwpd\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") " pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.518866 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.518839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2f8\" (UniqueName: \"kubernetes.io/projected/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-kube-api-access-xz2f8\") pod \"maas-controller-5476cb467b-6hwpd\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") " pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.625957 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.625927    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd846d64d-7ccj5"]
Jul 11 03:56:31.627590 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:56:31.627557    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50cd6d3_c8f1_4141_9609_fa86465217fd.slice/crio-d7d2bf30b7f9ea919e2271d952eecfadbcd026c7bbbeb075fa8ed43d19cd7a63 WatchSource:0}: Error finding container d7d2bf30b7f9ea919e2271d952eecfadbcd026c7bbbeb075fa8ed43d19cd7a63: Status 404 returned error can't find the container with id d7d2bf30b7f9ea919e2271d952eecfadbcd026c7bbbeb075fa8ed43d19cd7a63
Jul 11 03:56:31.652331 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.652304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:31.789858 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:31.789836    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5476cb467b-6hwpd"]
Jul 11 03:56:31.792828 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:56:31.792770    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6fe5f9_6a40_4bc3_b4de_25a18b3454ab.slice/crio-452d3dad38b93ba6e3a2f758c0c2e05a533e9f1dd2953107eb9f8784baab99c1 WatchSource:0}: Error finding container 452d3dad38b93ba6e3a2f758c0c2e05a533e9f1dd2953107eb9f8784baab99c1: Status 404 returned error can't find the container with id 452d3dad38b93ba6e3a2f758c0c2e05a533e9f1dd2953107eb9f8784baab99c1
Jul 11 03:56:32.113342 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:32.113311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476cb467b-6hwpd" event={"ID":"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab","Type":"ContainerStarted","Data":"452d3dad38b93ba6e3a2f758c0c2e05a533e9f1dd2953107eb9f8784baab99c1"}
Jul 11 03:56:32.114369 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:32.114346    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd846d64d-7ccj5" event={"ID":"b50cd6d3-c8f1-4141-9609-fa86465217fd","Type":"ContainerStarted","Data":"d7d2bf30b7f9ea919e2271d952eecfadbcd026c7bbbeb075fa8ed43d19cd7a63"}
Jul 11 03:56:34.656644 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:34.656602    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:34.756825 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:34.756696    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:56:35.137704 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:35.137666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476cb467b-6hwpd" event={"ID":"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab","Type":"ContainerStarted","Data":"166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88"}
Jul 11 03:56:35.137952 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:35.137869    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:35.139230 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:35.139202    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd846d64d-7ccj5" event={"ID":"b50cd6d3-c8f1-4141-9609-fa86465217fd","Type":"ContainerStarted","Data":"743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647"}
Jul 11 03:56:35.139368 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:35.139265    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:35.155310 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:35.155264    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5476cb467b-6hwpd" podStartSLOduration=1.5043938749999999 podStartE2EDuration="4.155249358s" totalImagesPullingTime="2.650855483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:56:35.153769981 +0000 UTC m=+494.237372322" watchObservedRunningTime="2026-07-11 03:56:35.155249358 +0000 UTC m=+494.238851674"
Jul 11 03:56:35.171021 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:35.170975    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fd846d64d-7ccj5" podStartSLOduration=1.366137231 podStartE2EDuration="4.170959396s" totalImagesPullingTime="2.804822165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:56:35.16987653 +0000 UTC m=+494.253478862" watchObservedRunningTime="2026-07-11 03:56:35.170959396 +0000 UTC m=+494.254561743"
Jul 11 03:56:46.146383 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.146351    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:46.146784 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.146427    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 03:56:46.212787 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.212748    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fd846d64d-7ccj5"]
Jul 11 03:56:46.213020 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.212998    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fd846d64d-7ccj5" podUID="b50cd6d3-c8f1-4141-9609-fa86465217fd" containerName="manager" containerID="cri-o://743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647" gracePeriod=30
Jul 11 03:56:46.457884 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.457856    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:46.550606 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.550573    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lpxc\" (UniqueName: \"kubernetes.io/projected/b50cd6d3-c8f1-4141-9609-fa86465217fd-kube-api-access-2lpxc\") pod \"b50cd6d3-c8f1-4141-9609-fa86465217fd\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") "
Jul 11 03:56:46.550836 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.550647    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b50cd6d3-c8f1-4141-9609-fa86465217fd-webhook-cert\") pod \"b50cd6d3-c8f1-4141-9609-fa86465217fd\" (UID: \"b50cd6d3-c8f1-4141-9609-fa86465217fd\") "
Jul 11 03:56:46.552923 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.552887    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50cd6d3-c8f1-4141-9609-fa86465217fd-kube-api-access-2lpxc" (OuterVolumeSpecName: "kube-api-access-2lpxc") pod "b50cd6d3-c8f1-4141-9609-fa86465217fd" (UID: "b50cd6d3-c8f1-4141-9609-fa86465217fd"). InnerVolumeSpecName "kube-api-access-2lpxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:56:46.553025 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.552945    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50cd6d3-c8f1-4141-9609-fa86465217fd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b50cd6d3-c8f1-4141-9609-fa86465217fd" (UID: "b50cd6d3-c8f1-4141-9609-fa86465217fd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:56:46.652311 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.652279    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lpxc\" (UniqueName: \"kubernetes.io/projected/b50cd6d3-c8f1-4141-9609-fa86465217fd-kube-api-access-2lpxc\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:56:46.652311 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:46.652306    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b50cd6d3-c8f1-4141-9609-fa86465217fd-webhook-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 03:56:47.198373 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.198336    2558 generic.go:356] "Generic (PLEG): container finished" podID="b50cd6d3-c8f1-4141-9609-fa86465217fd" containerID="743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647" exitCode=0
Jul 11 03:56:47.198797 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.198382    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd846d64d-7ccj5"
Jul 11 03:56:47.198797 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.198410    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd846d64d-7ccj5" event={"ID":"b50cd6d3-c8f1-4141-9609-fa86465217fd","Type":"ContainerDied","Data":"743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647"}
Jul 11 03:56:47.198797 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.198460    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd846d64d-7ccj5" event={"ID":"b50cd6d3-c8f1-4141-9609-fa86465217fd","Type":"ContainerDied","Data":"d7d2bf30b7f9ea919e2271d952eecfadbcd026c7bbbeb075fa8ed43d19cd7a63"}
Jul 11 03:56:47.198797 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.198489    2558 scope.go:117] "RemoveContainer" containerID="743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647"
Jul 11 03:56:47.207390 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.207372    2558 scope.go:117] "RemoveContainer" containerID="743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647"
Jul 11 03:56:47.207653 ip-10-0-138-121 kubenswrapper[2558]: E0711 03:56:47.207633    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647\": container with ID starting with 743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647 not found: ID does not exist" containerID="743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647"
Jul 11 03:56:47.207721 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.207679    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647"} err="failed to get container status \"743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647\": rpc error: code = NotFound desc = could not find container \"743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647\": container with ID starting with 743204133d86a2dadfa6dffb9335c2ce7ff69bdc38e2dea503326e663a94e647 not found: ID does not exist"
Jul 11 03:56:47.218615 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.218584    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fd846d64d-7ccj5"]
Jul 11 03:56:47.221353 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.221329    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fd846d64d-7ccj5"]
Jul 11 03:56:47.538153 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:56:47.538075    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b50cd6d3-c8f1-4141-9609-fa86465217fd" path="/var/lib/kubelet/pods/b50cd6d3-c8f1-4141-9609-fa86465217fd/volumes"
Jul 11 03:57:04.229185 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:04.229150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:04.286154 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:04.286119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:06.377570 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:06.377457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:06.469353 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:06.469311    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:06.872265 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:06.872229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:07.023481 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.023437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:07.309143 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.309040    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:07.412725 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.412686    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:07.419699 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.419671    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"]
Jul 11 03:57:07.420065 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.420052    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50cd6d3-c8f1-4141-9609-fa86465217fd" containerName="manager"
Jul 11 03:57:07.420111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.420067    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50cd6d3-c8f1-4141-9609-fa86465217fd" containerName="manager"
Jul 11 03:57:07.420156 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.420145    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b50cd6d3-c8f1-4141-9609-fa86465217fd" containerName="manager"
Jul 11 03:57:07.424750 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.424734    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.429552 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.429525    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 11 03:57:07.429689 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.429538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5m7vb\""
Jul 11 03:57:07.441181 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.441152    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"]
Jul 11 03:57:07.446515 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.446487    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"]
Jul 11 03:57:07.450090 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.450074    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.464442 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.464416    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"]
Jul 11 03:57:07.538336 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.538306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgc8m\" (UniqueName: \"kubernetes.io/projected/9e0a315a-f297-4355-8166-5053f45bd000-kube-api-access-dgc8m\") pod \"payload-pre-processing-74584bb9f8-jxfgx\" (UID: \"9e0a315a-f297-4355-8166-5053f45bd000\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.538537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.538350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bpg8\" (UniqueName: \"kubernetes.io/projected/26cf4400-30cd-4492-bc47-b983308a9941-kube-api-access-6bpg8\") pod \"payload-processing-f9b8d9b9b-pvm9r\" (UID: \"26cf4400-30cd-4492-bc47-b983308a9941\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.538537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.538485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e0a315a-f297-4355-8166-5053f45bd000-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jxfgx\" (UID: \"9e0a315a-f297-4355-8166-5053f45bd000\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.538537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.538527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26cf4400-30cd-4492-bc47-b983308a9941-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pvm9r\" (UID: \"26cf4400-30cd-4492-bc47-b983308a9941\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.639755 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.639712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e0a315a-f297-4355-8166-5053f45bd000-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jxfgx\" (UID: \"9e0a315a-f297-4355-8166-5053f45bd000\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.639966 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.639853    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26cf4400-30cd-4492-bc47-b983308a9941-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pvm9r\" (UID: \"26cf4400-30cd-4492-bc47-b983308a9941\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.639966 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.639958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgc8m\" (UniqueName: \"kubernetes.io/projected/9e0a315a-f297-4355-8166-5053f45bd000-kube-api-access-dgc8m\") pod \"payload-pre-processing-74584bb9f8-jxfgx\" (UID: \"9e0a315a-f297-4355-8166-5053f45bd000\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.640097 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.640000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bpg8\" (UniqueName: \"kubernetes.io/projected/26cf4400-30cd-4492-bc47-b983308a9941-kube-api-access-6bpg8\") pod \"payload-processing-f9b8d9b9b-pvm9r\" (UID: \"26cf4400-30cd-4492-bc47-b983308a9941\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.640603 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.640581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26cf4400-30cd-4492-bc47-b983308a9941-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pvm9r\" (UID: \"26cf4400-30cd-4492-bc47-b983308a9941\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.640713 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.640660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e0a315a-f297-4355-8166-5053f45bd000-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jxfgx\" (UID: \"9e0a315a-f297-4355-8166-5053f45bd000\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.648115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.648084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgc8m\" (UniqueName: \"kubernetes.io/projected/9e0a315a-f297-4355-8166-5053f45bd000-kube-api-access-dgc8m\") pod \"payload-pre-processing-74584bb9f8-jxfgx\" (UID: \"9e0a315a-f297-4355-8166-5053f45bd000\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.648115 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.648107    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bpg8\" (UniqueName: \"kubernetes.io/projected/26cf4400-30cd-4492-bc47-b983308a9941-kube-api-access-6bpg8\") pod \"payload-processing-f9b8d9b9b-pvm9r\" (UID: \"26cf4400-30cd-4492-bc47-b983308a9941\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.735632 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.735602    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:07.760217 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.760188    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:07.891482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.891448    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"]
Jul 11 03:57:07.893167 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:57:07.893127    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0a315a_f297_4355_8166_5053f45bd000.slice/crio-c582be4943acdd218c1ab69ee432d5a204729f3ce9eb0920e2c30de8a975ab9c WatchSource:0}: Error finding container c582be4943acdd218c1ab69ee432d5a204729f3ce9eb0920e2c30de8a975ab9c: Status 404 returned error can't find the container with id c582be4943acdd218c1ab69ee432d5a204729f3ce9eb0920e2c30de8a975ab9c
Jul 11 03:57:07.917356 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:07.917331    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"]
Jul 11 03:57:07.919410 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:57:07.919380    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cf4400_30cd_4492_bc47_b983308a9941.slice/crio-c585bb14a389c35cc606da745671ed613207a6d374e4399b569b6c0505eec586 WatchSource:0}: Error finding container c585bb14a389c35cc606da745671ed613207a6d374e4399b569b6c0505eec586: Status 404 returned error can't find the container with id c585bb14a389c35cc606da745671ed613207a6d374e4399b569b6c0505eec586
Jul 11 03:57:08.307908 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:08.307777    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r" event={"ID":"26cf4400-30cd-4492-bc47-b983308a9941","Type":"ContainerStarted","Data":"c585bb14a389c35cc606da745671ed613207a6d374e4399b569b6c0505eec586"}
Jul 11 03:57:08.309559 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:08.309522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx" event={"ID":"9e0a315a-f297-4355-8166-5053f45bd000","Type":"ContainerStarted","Data":"c582be4943acdd218c1ab69ee432d5a204729f3ce9eb0920e2c30de8a975ab9c"}
Jul 11 03:57:10.336421 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:10.336379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r" event={"ID":"26cf4400-30cd-4492-bc47-b983308a9941","Type":"ContainerStarted","Data":"35d143d92429874e7a086309bb1515b91d51a5ef6c8b6ee77c5585a12c1d248e"}
Jul 11 03:57:10.337051 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:10.336631    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:10.338106 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:10.338081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx" event={"ID":"9e0a315a-f297-4355-8166-5053f45bd000","Type":"ContainerStarted","Data":"b86506d8ea9ff3af5d56a14f409eab8e87db3b3b97bd0494b96ba085246aca58"}
Jul 11 03:57:10.338237 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:10.338131    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:10.352344 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:10.352303    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r" podStartSLOduration=1.867376202 podStartE2EDuration="3.352289432s" totalImagesPullingTime="1.48491323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:57:10.350927752 +0000 UTC m=+529.434530064" watchObservedRunningTime="2026-07-11 03:57:10.352289432 +0000 UTC m=+529.435891743"
Jul 11 03:57:10.366423 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:10.366375    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx" podStartSLOduration=1.8436111400000001 podStartE2EDuration="3.366359967s" totalImagesPullingTime="1.522748827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:57:10.365468631 +0000 UTC m=+529.449070969" watchObservedRunningTime="2026-07-11 03:57:10.366359967 +0000 UTC m=+529.449962279"
Jul 11 03:57:15.369122 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:15.369088    2558 generic.go:356] "Generic (PLEG): container finished" podID="a5e202f9-7f6a-427c-9fad-dbb1f1daf717" containerID="8d6b38558f0b943e73715d352d56880d41f4c9fb5d4b06fa70e0a1d6e1cc7d99" exitCode=0
Jul 11 03:57:15.369539 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:15.369132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" event={"ID":"a5e202f9-7f6a-427c-9fad-dbb1f1daf717","Type":"ContainerDied","Data":"8d6b38558f0b943e73715d352d56880d41f4c9fb5d4b06fa70e0a1d6e1cc7d99"}
Jul 11 03:57:15.369539 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:15.369523    2558 scope.go:117] "RemoveContainer" containerID="8d6b38558f0b943e73715d352d56880d41f4c9fb5d4b06fa70e0a1d6e1cc7d99"
Jul 11 03:57:15.370537 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:15.370505    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:57:15.370617 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:15.370598    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:57:15.370656 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:15.370644    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 03:57:16.376917 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:16.376885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" event={"ID":"a5e202f9-7f6a-427c-9fad-dbb1f1daf717","Type":"ContainerStarted","Data":"2a6916c098cbaf3026cf095b6f1463b344f123129f2c8abd3366d5a1de86cece"}
Jul 11 03:57:17.362556 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:17.362523    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:57:17.362766 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:17.362731    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7xft6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 11 03:57:17.362887 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:17.362790    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" podUID="a5e202f9-7f6a-427c-9fad-dbb1f1daf717" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 11 03:57:17.828117 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:17.828018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:17.920688 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:17.920636    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:18.363185 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:18.363142    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7xft6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 11 03:57:18.363394 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:18.363207    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" podUID="a5e202f9-7f6a-427c-9fad-dbb1f1daf717" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 11 03:57:19.362519 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:19.362477    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7xft6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 11 03:57:19.362964 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:19.362535    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6" podUID="a5e202f9-7f6a-427c-9fad-dbb1f1daf717" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 11 03:57:20.366980 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:20.366947    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:57:20.367457 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:20.367317    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:57:20.367982 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:20.367965    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7xft6"
Jul 11 03:57:21.345282 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:21.345238    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx" podUID="9e0a315a-f297-4355-8166-5053f45bd000" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.52:9004: connect: connection refused"
Jul 11 03:57:21.345640 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:21.345622    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pvm9r"
Jul 11 03:57:25.280762 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.280727    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"]
Jul 11 03:57:25.285818 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.285776    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.289463 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.289428    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 11 03:57:25.289463 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.289442    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 11 03:57:25.289463 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.289435    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 11 03:57:25.289673 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.289435    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lnw2c\""
Jul 11 03:57:25.292371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.292348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.292520 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.292400    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.292520 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.292468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd82aee-8597-43b9-8137-62ffeb4be0bf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.292641 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.292548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n44f\" (UniqueName: \"kubernetes.io/projected/bfd82aee-8597-43b9-8137-62ffeb4be0bf-kube-api-access-2n44f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.292641 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.292612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.292754 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.292650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.293517 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.293493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"]
Jul 11 03:57:25.374264 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.374220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:25.393336 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.393482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.393482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd82aee-8597-43b9-8137-62ffeb4be0bf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.393482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n44f\" (UniqueName: \"kubernetes.io/projected/bfd82aee-8597-43b9-8137-62ffeb4be0bf-kube-api-access-2n44f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.393482 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.393682 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.393830 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.393964 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.394039 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.393908    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.395548 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.395525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfd82aee-8597-43b9-8137-62ffeb4be0bf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.395865 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.395847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfd82aee-8597-43b9-8137-62ffeb4be0bf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.400926 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.400900    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n44f\" (UniqueName: \"kubernetes.io/projected/bfd82aee-8597-43b9-8137-62ffeb4be0bf-kube-api-access-2n44f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7\" (UID: \"bfd82aee-8597-43b9-8137-62ffeb4be0bf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.596863 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.596776    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:25.736077 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:25.735993    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"]
Jul 11 03:57:25.737704 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:57:25.737671    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd82aee_8597_43b9_8137_62ffeb4be0bf.slice/crio-9f11f435a9ba05702172c44a4ed6fd923e178b56191bf06dd013fecb40150dc0 WatchSource:0}: Error finding container 9f11f435a9ba05702172c44a4ed6fd923e178b56191bf06dd013fecb40150dc0: Status 404 returned error can't find the container with id 9f11f435a9ba05702172c44a4ed6fd923e178b56191bf06dd013fecb40150dc0
Jul 11 03:57:26.430247 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:26.430205    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7" event={"ID":"bfd82aee-8597-43b9-8137-62ffeb4be0bf","Type":"ContainerStarted","Data":"9f11f435a9ba05702172c44a4ed6fd923e178b56191bf06dd013fecb40150dc0"}
Jul 11 03:57:27.436546 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:27.436502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7" event={"ID":"bfd82aee-8597-43b9-8137-62ffeb4be0bf","Type":"ContainerStarted","Data":"55883419a6085260a2873cdfb00ec0913634b4fcae5376f856b4931953bb3a80"}
Jul 11 03:57:27.452709 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:27.452652    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7" podStartSLOduration=1.304118071 podStartE2EDuration="2.452636964s" totalImagesPullingTime="1.148518893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:57:27.4519349 +0000 UTC m=+546.535537235" watchObservedRunningTime="2026-07-11 03:57:27.452636964 +0000 UTC m=+546.536239275"
Jul 11 03:57:31.344444 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:31.344411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jxfgx"
Jul 11 03:57:35.597073 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:35.597028    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:35.597483 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:35.597096    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:35.609463 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:35.609435    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:36.492174 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:36.492141    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7"
Jul 11 03:57:38.526350 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:38.526309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:51.376705 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.376668    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"]
Jul 11 03:57:51.380876 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.380854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.383333 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.383314    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 11 03:57:51.387351 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.387328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"]
Jul 11 03:57:51.409089 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.409044    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:57:51.419196 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.419163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.419362 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.419278    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.419362 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.419324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.419462 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.419360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.419462 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.419413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mphd\" (UniqueName: \"kubernetes.io/projected/0157473a-1dce-4430-b288-8f6e4e4b5420-kube-api-access-9mphd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.419462 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.419443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0157473a-1dce-4430-b288-8f6e4e4b5420-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.520531 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.520496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0157473a-1dce-4430-b288-8f6e4e4b5420-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.520719 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.520542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.520719 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.520626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.520719 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.520667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.520719 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.520699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.520953 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.520747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mphd\" (UniqueName: \"kubernetes.io/projected/0157473a-1dce-4430-b288-8f6e4e4b5420-kube-api-access-9mphd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.521098 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.521068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.521164 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.521074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.521164 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.521123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.522859 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.522832    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0157473a-1dce-4430-b288-8f6e4e4b5420-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.523006 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.522991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0157473a-1dce-4430-b288-8f6e4e4b5420-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.528485 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.528463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mphd\" (UniqueName: \"kubernetes.io/projected/0157473a-1dce-4430-b288-8f6e4e4b5420-kube-api-access-9mphd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llp2w\" (UID: \"0157473a-1dce-4430-b288-8f6e4e4b5420\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.693583 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.693478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:57:51.836111 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:51.836088    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"]
Jul 11 03:57:51.838008 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:57:51.837981    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0157473a_1dce_4430_b288_8f6e4e4b5420.slice/crio-8ba8ee4d05cfb3a04fecd125769a5214734e4330c44c850910019ebb2d659025 WatchSource:0}: Error finding container 8ba8ee4d05cfb3a04fecd125769a5214734e4330c44c850910019ebb2d659025: Status 404 returned error can't find the container with id 8ba8ee4d05cfb3a04fecd125769a5214734e4330c44c850910019ebb2d659025
Jul 11 03:57:52.563371 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:52.563327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w" event={"ID":"0157473a-1dce-4430-b288-8f6e4e4b5420","Type":"ContainerStarted","Data":"0f80f521fdcba9ae179b5acea47a1cc7185047bea6e505d1906f5633600b6c08"}
Jul 11 03:57:52.563771 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:52.563393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w" event={"ID":"0157473a-1dce-4430-b288-8f6e4e4b5420","Type":"ContainerStarted","Data":"8ba8ee4d05cfb3a04fecd125769a5214734e4330c44c850910019ebb2d659025"}
Jul 11 03:57:52.579191 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:52.579140    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w" podStartSLOduration=1.398997748 podStartE2EDuration="1.579124928s" totalImagesPullingTime="180.12718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:57:52.578166673 +0000 UTC m=+571.661768986" watchObservedRunningTime="2026-07-11 03:57:52.579124928 +0000 UTC m=+571.662727239"
Jul 11 03:57:54.608435 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:57:54.608387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:58:01.693610 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:01.693570    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:58:01.694168 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:01.693645    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:58:01.709615 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:01.709589    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:58:02.628287 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:02.628256    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llp2w"
Jul 11 03:58:21.519419 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:21.519385    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 03:58:21.523388 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:21.523363    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 03:58:21.778853 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:21.778741    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:58:27.595898 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:58:27.595851    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:59:39.171225 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.171188    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68bbbb5b67-k9jpl"]
Jul 11 03:59:39.174908 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.174889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.178574 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.178537    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 11 03:59:39.178574 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.178538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9nlfg\""
Jul 11 03:59:39.181824 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.181780    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bbbb5b67-k9jpl"]
Jul 11 03:59:39.313581 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.313535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/caf7e6e0-a859-4576-9edc-8fc49aca9efc-tls-cert\") pod \"authorino-68bbbb5b67-k9jpl\" (UID: \"caf7e6e0-a859-4576-9edc-8fc49aca9efc\") " pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.313581 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.313587    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7prb\" (UniqueName: \"kubernetes.io/projected/caf7e6e0-a859-4576-9edc-8fc49aca9efc-kube-api-access-g7prb\") pod \"authorino-68bbbb5b67-k9jpl\" (UID: \"caf7e6e0-a859-4576-9edc-8fc49aca9efc\") " pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.414444 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.414405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/caf7e6e0-a859-4576-9edc-8fc49aca9efc-tls-cert\") pod \"authorino-68bbbb5b67-k9jpl\" (UID: \"caf7e6e0-a859-4576-9edc-8fc49aca9efc\") " pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.414624 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.414461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7prb\" (UniqueName: \"kubernetes.io/projected/caf7e6e0-a859-4576-9edc-8fc49aca9efc-kube-api-access-g7prb\") pod \"authorino-68bbbb5b67-k9jpl\" (UID: \"caf7e6e0-a859-4576-9edc-8fc49aca9efc\") " pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.416938 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.416913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/caf7e6e0-a859-4576-9edc-8fc49aca9efc-tls-cert\") pod \"authorino-68bbbb5b67-k9jpl\" (UID: \"caf7e6e0-a859-4576-9edc-8fc49aca9efc\") " pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.422450 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.422394    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7prb\" (UniqueName: \"kubernetes.io/projected/caf7e6e0-a859-4576-9edc-8fc49aca9efc-kube-api-access-g7prb\") pod \"authorino-68bbbb5b67-k9jpl\" (UID: \"caf7e6e0-a859-4576-9edc-8fc49aca9efc\") " pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.485008 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.484977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bbbb5b67-k9jpl"
Jul 11 03:59:39.597522 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.597485    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 03:59:39.632093 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.632065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bbbb5b67-k9jpl"]
Jul 11 03:59:39.634163 ip-10-0-138-121 kubenswrapper[2558]: W0711 03:59:39.634126    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaf7e6e0_a859_4576_9edc_8fc49aca9efc.slice/crio-ab1e5c6c9a6b107fb1fc3ff2ecdbeca5942ea04f481f3dcd546538051566d702 WatchSource:0}: Error finding container ab1e5c6c9a6b107fb1fc3ff2ecdbeca5942ea04f481f3dcd546538051566d702: Status 404 returned error can't find the container with id ab1e5c6c9a6b107fb1fc3ff2ecdbeca5942ea04f481f3dcd546538051566d702
Jul 11 03:59:39.635784 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:39.635765    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 03:59:40.106358 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:40.106314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bbbb5b67-k9jpl" event={"ID":"caf7e6e0-a859-4576-9edc-8fc49aca9efc","Type":"ContainerStarted","Data":"f07384eaa9030fa184a1c92b166e24e41d58986d3472372b646f6faf18cf8d1d"}
Jul 11 03:59:40.106564 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:40.106368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bbbb5b67-k9jpl" event={"ID":"caf7e6e0-a859-4576-9edc-8fc49aca9efc","Type":"ContainerStarted","Data":"ab1e5c6c9a6b107fb1fc3ff2ecdbeca5942ea04f481f3dcd546538051566d702"}
Jul 11 03:59:40.126186 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:40.126129    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68bbbb5b67-k9jpl" podStartSLOduration=0.805299892 podStartE2EDuration="1.12611259s" totalImagesPullingTime="320.812698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:59:40.124632437 +0000 UTC m=+679.208234774" watchObservedRunningTime="2026-07-11 03:59:40.12611259 +0000 UTC m=+679.209714902"
Jul 11 03:59:40.846570 ip-10-0-138-121 kubenswrapper[2558]: I0711 03:59:40.846531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:00:50.735977 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:50.735931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:00:50.838032 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:50.837996    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5476cb467b-6hwpd"]
Jul 11 04:00:50.838283 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:50.838253    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5476cb467b-6hwpd" podUID="8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" containerName="manager" containerID="cri-o://166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88" gracePeriod=30
Jul 11 04:00:51.098193 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.098165    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 04:00:51.158365 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.158327    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-webhook-cert\") pod \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") "
Jul 11 04:00:51.158564 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.158428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz2f8\" (UniqueName: \"kubernetes.io/projected/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-kube-api-access-xz2f8\") pod \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\" (UID: \"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab\") "
Jul 11 04:00:51.160397 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.160363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-kube-api-access-xz2f8" (OuterVolumeSpecName: "kube-api-access-xz2f8") pod "8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" (UID: "8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab"). InnerVolumeSpecName "kube-api-access-xz2f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:00:51.160528 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.160424    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" (UID: "8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:00:51.259720 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.259624    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-webhook-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:00:51.259720 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.259656    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz2f8\" (UniqueName: \"kubernetes.io/projected/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab-kube-api-access-xz2f8\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:00:51.477755 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.477716    2558 generic.go:356] "Generic (PLEG): container finished" podID="8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" containerID="166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88" exitCode=0
Jul 11 04:00:51.477951 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.477762    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476cb467b-6hwpd"
Jul 11 04:00:51.477951 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.477824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476cb467b-6hwpd" event={"ID":"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab","Type":"ContainerDied","Data":"166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88"}
Jul 11 04:00:51.477951 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.477879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476cb467b-6hwpd" event={"ID":"8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab","Type":"ContainerDied","Data":"452d3dad38b93ba6e3a2f758c0c2e05a533e9f1dd2953107eb9f8784baab99c1"}
Jul 11 04:00:51.477951 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.477904    2558 scope.go:117] "RemoveContainer" containerID="166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88"
Jul 11 04:00:51.487446 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.487424    2558 scope.go:117] "RemoveContainer" containerID="166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88"
Jul 11 04:00:51.487724 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:00:51.487705    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88\": container with ID starting with 166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88 not found: ID does not exist" containerID="166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88"
Jul 11 04:00:51.487786 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.487734    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88"} err="failed to get container status \"166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88\": rpc error: code = NotFound desc = could not find container \"166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88\": container with ID starting with 166f1b33b7934ab1e2bf98c14602ba753e5e3c4f951c379acafe8938bbf07f88 not found: ID does not exist"
Jul 11 04:00:51.499142 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.499098    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5476cb467b-6hwpd"]
Jul 11 04:00:51.502202 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.502174    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5476cb467b-6hwpd"]
Jul 11 04:00:51.539344 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:51.539261    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" path="/var/lib/kubelet/pods/8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab/volumes"
Jul 11 04:00:52.128760 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.128721    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:00:52.241495 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.241462    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5476cb467b-d6zg5"]
Jul 11 04:00:52.241896 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.241883    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" containerName="manager"
Jul 11 04:00:52.241896 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.241897    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" containerName="manager"
Jul 11 04:00:52.241998 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.241976    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e6fe5f9-6a40-4bc3-b4de-25a18b3454ab" containerName="manager"
Jul 11 04:00:52.246385 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.246366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.250120 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.250099    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 11 04:00:52.250256 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.250100    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rm24q\""
Jul 11 04:00:52.250256 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.250101    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 11 04:00:52.255155 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.255133    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5476cb467b-d6zg5"]
Jul 11 04:00:52.267238 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.267210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blwkx\" (UniqueName: \"kubernetes.io/projected/860c3c59-8ed3-4695-85fe-0ea70eae1abe-kube-api-access-blwkx\") pod \"maas-controller-5476cb467b-d6zg5\" (UID: \"860c3c59-8ed3-4695-85fe-0ea70eae1abe\") " pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.267409 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.267264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/860c3c59-8ed3-4695-85fe-0ea70eae1abe-webhook-cert\") pod \"maas-controller-5476cb467b-d6zg5\" (UID: \"860c3c59-8ed3-4695-85fe-0ea70eae1abe\") " pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.368250 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.368213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blwkx\" (UniqueName: \"kubernetes.io/projected/860c3c59-8ed3-4695-85fe-0ea70eae1abe-kube-api-access-blwkx\") pod \"maas-controller-5476cb467b-d6zg5\" (UID: \"860c3c59-8ed3-4695-85fe-0ea70eae1abe\") " pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.368436 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.368268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/860c3c59-8ed3-4695-85fe-0ea70eae1abe-webhook-cert\") pod \"maas-controller-5476cb467b-d6zg5\" (UID: \"860c3c59-8ed3-4695-85fe-0ea70eae1abe\") " pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.370681 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.370659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/860c3c59-8ed3-4695-85fe-0ea70eae1abe-webhook-cert\") pod \"maas-controller-5476cb467b-d6zg5\" (UID: \"860c3c59-8ed3-4695-85fe-0ea70eae1abe\") " pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.376638 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.376610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blwkx\" (UniqueName: \"kubernetes.io/projected/860c3c59-8ed3-4695-85fe-0ea70eae1abe-kube-api-access-blwkx\") pod \"maas-controller-5476cb467b-d6zg5\" (UID: \"860c3c59-8ed3-4695-85fe-0ea70eae1abe\") " pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.558311 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.558213    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:52.705917 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:52.705832    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5476cb467b-d6zg5"]
Jul 11 04:00:52.707246 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:00:52.707212    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860c3c59_8ed3_4695_85fe_0ea70eae1abe.slice/crio-2f956c944372ebd58dc3c80259cfab27131b1ba7eedb1681f598efce50b7d0ad WatchSource:0}: Error finding container 2f956c944372ebd58dc3c80259cfab27131b1ba7eedb1681f598efce50b7d0ad: Status 404 returned error can't find the container with id 2f956c944372ebd58dc3c80259cfab27131b1ba7eedb1681f598efce50b7d0ad
Jul 11 04:00:53.490938 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:53.490849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476cb467b-d6zg5" event={"ID":"860c3c59-8ed3-4695-85fe-0ea70eae1abe","Type":"ContainerStarted","Data":"46e6807dc57c3f739e6e815e9c2c95ef5735f2c70cd09b1f25265aa6575e6cd8"}
Jul 11 04:00:53.490938 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:53.490908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5476cb467b-d6zg5" event={"ID":"860c3c59-8ed3-4695-85fe-0ea70eae1abe","Type":"ContainerStarted","Data":"2f956c944372ebd58dc3c80259cfab27131b1ba7eedb1681f598efce50b7d0ad"}
Jul 11 04:00:53.491357 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:53.491035    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:00:53.509879 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:00:53.509819    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5476cb467b-d6zg5" podStartSLOduration=1.017030902 podStartE2EDuration="1.509790561s" totalImagesPullingTime="492.759659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:00:53.50679014 +0000 UTC m=+752.590392455" watchObservedRunningTime="2026-07-11 04:00:53.509790561 +0000 UTC m=+752.593392873"
Jul 11 04:01:04.497664 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:04.497630    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5476cb467b-d6zg5"
Jul 11 04:01:31.050688 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:31.050651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:31.149618 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:31.149575    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:31.271447 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:31.271416    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:36.877055 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:36.877011    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:36.971982 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:36.971947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:37.068879 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:37.068838    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:37.297202 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:37.297108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:42.738371 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:42.738337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:01:42.795573 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:01:42.795539    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:02:08.046417 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:02:08.046383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:02:08.148015 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:02:08.147978    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:03:21.558781 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:03:21.558700    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:03:21.562180 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:03:21.562158    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:03:36.493623 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:03:36.493570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:03:36.595488 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:03:36.595455    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:04:14.463816 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:04:14.463773    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:05:08.712043 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:08.711958    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:05:17.792906 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:17.792858    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:05:49.129319 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:49.129274    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"]
Jul 11 04:05:49.129988 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:49.129483    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h" podUID="25646b46-80c5-41f0-a8d6-8db0147b7ffc" containerName="manager" containerID="cri-o://1247c2abfe6459b7613f517e0b4f1b2c50ef2b4411788b2701e27157cdde551f" gracePeriod=10
Jul 11 04:05:53.068623 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.068590    2558 generic.go:356] "Generic (PLEG): container finished" podID="25646b46-80c5-41f0-a8d6-8db0147b7ffc" containerID="1247c2abfe6459b7613f517e0b4f1b2c50ef2b4411788b2701e27157cdde551f" exitCode=0
Jul 11 04:05:53.069023 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.068669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h" event={"ID":"25646b46-80c5-41f0-a8d6-8db0147b7ffc","Type":"ContainerDied","Data":"1247c2abfe6459b7613f517e0b4f1b2c50ef2b4411788b2701e27157cdde551f"}
Jul 11 04:05:53.196074 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.196046    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 04:05:53.258661 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.258577    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25646b46-80c5-41f0-a8d6-8db0147b7ffc-extensions-socket-volume\") pod \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") "
Jul 11 04:05:53.258940 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.258700    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx9tk\" (UniqueName: \"kubernetes.io/projected/25646b46-80c5-41f0-a8d6-8db0147b7ffc-kube-api-access-sx9tk\") pod \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\" (UID: \"25646b46-80c5-41f0-a8d6-8db0147b7ffc\") "
Jul 11 04:05:53.259040 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.259011    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25646b46-80c5-41f0-a8d6-8db0147b7ffc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "25646b46-80c5-41f0-a8d6-8db0147b7ffc" (UID: "25646b46-80c5-41f0-a8d6-8db0147b7ffc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:05:53.260899 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.260768    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25646b46-80c5-41f0-a8d6-8db0147b7ffc-kube-api-access-sx9tk" (OuterVolumeSpecName: "kube-api-access-sx9tk") pod "25646b46-80c5-41f0-a8d6-8db0147b7ffc" (UID: "25646b46-80c5-41f0-a8d6-8db0147b7ffc"). InnerVolumeSpecName "kube-api-access-sx9tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:05:53.359666 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.359626    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx9tk\" (UniqueName: \"kubernetes.io/projected/25646b46-80c5-41f0-a8d6-8db0147b7ffc-kube-api-access-sx9tk\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:05:53.359666 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:53.359663    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25646b46-80c5-41f0-a8d6-8db0147b7ffc-extensions-socket-volume\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:05:54.074605 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:54.074569    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"
Jul 11 04:05:54.075080 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:54.074564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h" event={"ID":"25646b46-80c5-41f0-a8d6-8db0147b7ffc","Type":"ContainerDied","Data":"f8476cf4ef9e6b766b86820e7d4e1172046b771e5524ffb489b9e23e0c342c9b"}
Jul 11 04:05:54.075080 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:54.074715    2558 scope.go:117] "RemoveContainer" containerID="1247c2abfe6459b7613f517e0b4f1b2c50ef2b4411788b2701e27157cdde551f"
Jul 11 04:05:54.092398 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:54.092345    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"]
Jul 11 04:05:54.095152 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:54.095127    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfr8h"]
Jul 11 04:05:55.541240 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:05:55.541205    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25646b46-80c5-41f0-a8d6-8db0147b7ffc" path="/var/lib/kubelet/pods/25646b46-80c5-41f0-a8d6-8db0147b7ffc/volumes"
Jul 11 04:06:50.271561 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.271523    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"]
Jul 11 04:06:50.272017 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.271971    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25646b46-80c5-41f0-a8d6-8db0147b7ffc" containerName="manager"
Jul 11 04:06:50.272017 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.271984    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="25646b46-80c5-41f0-a8d6-8db0147b7ffc" containerName="manager"
Jul 11 04:06:50.272090 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.272050    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="25646b46-80c5-41f0-a8d6-8db0147b7ffc" containerName="manager"
Jul 11 04:06:50.275233 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.275216    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.278103 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.278081    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mhf9b\""
Jul 11 04:06:50.288271 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.288248    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"]
Jul 11 04:06:50.371503 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.371470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3fa1114-71ca-4e78-83e1-704aa96bbabb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tkrsm\" (UID: \"f3fa1114-71ca-4e78-83e1-704aa96bbabb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.371710 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.371529    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6w4r\" (UniqueName: \"kubernetes.io/projected/f3fa1114-71ca-4e78-83e1-704aa96bbabb-kube-api-access-f6w4r\") pod \"kuadrant-operator-controller-manager-86878c769f-tkrsm\" (UID: \"f3fa1114-71ca-4e78-83e1-704aa96bbabb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.472350 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.472263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3fa1114-71ca-4e78-83e1-704aa96bbabb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tkrsm\" (UID: \"f3fa1114-71ca-4e78-83e1-704aa96bbabb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.472544 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.472422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6w4r\" (UniqueName: \"kubernetes.io/projected/f3fa1114-71ca-4e78-83e1-704aa96bbabb-kube-api-access-f6w4r\") pod \"kuadrant-operator-controller-manager-86878c769f-tkrsm\" (UID: \"f3fa1114-71ca-4e78-83e1-704aa96bbabb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.472624 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.472602    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3fa1114-71ca-4e78-83e1-704aa96bbabb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tkrsm\" (UID: \"f3fa1114-71ca-4e78-83e1-704aa96bbabb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.481554 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.481524    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6w4r\" (UniqueName: \"kubernetes.io/projected/f3fa1114-71ca-4e78-83e1-704aa96bbabb-kube-api-access-f6w4r\") pod \"kuadrant-operator-controller-manager-86878c769f-tkrsm\" (UID: \"f3fa1114-71ca-4e78-83e1-704aa96bbabb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.585768 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.585672    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:50.741444 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:50.741417    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"]
Jul 11 04:06:50.743698 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:06:50.743675    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fa1114_71ca_4e78_83e1_704aa96bbabb.slice/crio-e1b89c14528ce9d52e0652a705bb8eaefb8a8a257209fc370a3a64b0b7d3a83e WatchSource:0}: Error finding container e1b89c14528ce9d52e0652a705bb8eaefb8a8a257209fc370a3a64b0b7d3a83e: Status 404 returned error can't find the container with id e1b89c14528ce9d52e0652a705bb8eaefb8a8a257209fc370a3a64b0b7d3a83e
Jul 11 04:06:51.379136 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:51.379097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm" event={"ID":"f3fa1114-71ca-4e78-83e1-704aa96bbabb","Type":"ContainerStarted","Data":"83e43539d14fb37327dfc536ae0769c9bf81e92cd957f26a13482c1ab52ae328"}
Jul 11 04:06:51.379658 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:51.379150    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm" event={"ID":"f3fa1114-71ca-4e78-83e1-704aa96bbabb","Type":"ContainerStarted","Data":"e1b89c14528ce9d52e0652a705bb8eaefb8a8a257209fc370a3a64b0b7d3a83e"}
Jul 11 04:06:51.379658 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:51.379230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:06:51.399509 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:06:51.399459    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm" podStartSLOduration=1.399443846 podStartE2EDuration="1.399443846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:06:51.397091547 +0000 UTC m=+1110.480693881" watchObservedRunningTime="2026-07-11 04:06:51.399443846 +0000 UTC m=+1110.483046231"
Jul 11 04:07:02.386663 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:07:02.386626    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkrsm"
Jul 11 04:08:21.592640 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:08:21.592516    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:08:21.596757 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:08:21.595897    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:10:21.592868 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:10:21.592795    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:10:22.666395 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:10:22.666359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:10:30.397649 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:10:30.397605    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:12:26.352849 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:12:26.352739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:12:51.065972 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:12:51.065933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:12:57.705126 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:12:57.705089    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:05.994023 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:05.993987    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:11.087964 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:11.087920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:14.056787 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:14.056744    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:14.155819 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:14.155761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:14.474826 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:14.474765    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:20.139534 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.139498    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:20.205203 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.205165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:20.310128 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.310088    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"]
Jul 11 04:13:20.314059 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.314034    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.316597 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.316573    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9ed97a74-openshift-default-dockercfg-wqnlt\""
Jul 11 04:13:20.334242 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.334214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"]
Jul 11 04:13:20.340778 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.340750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:20.402103 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.402012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:20.417859 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.417822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-envoy\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418053 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.417877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-data\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418053 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.417907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istiod-ca-cert\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418053 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.417946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-podinfo\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418053 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.417983    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-credential-socket\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418240 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.418061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcg9\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-kube-api-access-4zcg9\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418240 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.418107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-socket\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418240 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.418136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-certs\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.418350 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.418295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-token\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519071 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-envoy\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519071 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-data\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519346 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519090    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istiod-ca-cert\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519346 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-podinfo\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519346 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-credential-socket\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519346 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcg9\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-kube-api-access-4zcg9\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519559 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-socket\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519559 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-data\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519672 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-certs\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519722 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-socket\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519779 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519747    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-credential-socket\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519875 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-token\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.519948 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istiod-ca-cert\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.520003 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.519967    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-certs\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.521502 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.521476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-envoy\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.521825 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.521782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-podinfo\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.527151 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.527130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-token\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.527258 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.527199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcg9\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-kube-api-access-4zcg9\") pod \"e2e-ait-9ed97a74-openshift-default-698d864f87-6shst\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") " pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.626734 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.626698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:20.769676 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.769653    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"]
Jul 11 04:13:20.771075 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:13:20.771048    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc639cd4a_21c1_4499_8ce4_a5b8fd7a1754.slice/crio-8531810afb7e71f40ac79b989f18a6fe06ba64ac555c898f48a573f16fb75aec WatchSource:0}: Error finding container 8531810afb7e71f40ac79b989f18a6fe06ba64ac555c898f48a573f16fb75aec: Status 404 returned error can't find the container with id 8531810afb7e71f40ac79b989f18a6fe06ba64ac555c898f48a573f16fb75aec
Jul 11 04:13:20.773063 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.773032    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:13:20.773156 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.773095    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:13:20.773156 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:20.773124    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:13:21.431653 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.431614    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" event={"ID":"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754","Type":"ContainerStarted","Data":"9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680"}
Jul 11 04:13:21.432102 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.431678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" event={"ID":"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754","Type":"ContainerStarted","Data":"8531810afb7e71f40ac79b989f18a6fe06ba64ac555c898f48a573f16fb75aec"}
Jul 11 04:13:21.438628 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.438583    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:21.452563 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.452508    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podStartSLOduration=1.452474117 podStartE2EDuration="1.452474117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:13:21.451626615 +0000 UTC m=+1500.535228977" watchObservedRunningTime="2026-07-11 04:13:21.452474117 +0000 UTC m=+1500.536076430"
Jul 11 04:13:21.529470 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.529413    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:21.593242 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.593117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:21.625282 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.625250    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:13:21.627066 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.627044    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:21.636138 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.636115    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:13:21.662145 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:21.662099    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:22.186436 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:22.186396    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:22.287938 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:22.287899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:22.437023 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:22.436945    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:22.438038 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:22.438020    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:22.449903 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:22.449873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:23.839510 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:23.839480    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:13:37.811926 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:37.810758    2558 patch_prober.go:28] interesting pod/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:45674->10.132.0.59:15021: read: connection reset by peer" start-of-body=
Jul 11 04:13:37.811926 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:37.810856    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:45674->10.132.0.59:15021: read: connection reset by peer"
Jul 11 04:13:38.525664 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:38.525627    2558 generic.go:356] "Generic (PLEG): container finished" podID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerID="9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680" exitCode=0
Jul 11 04:13:38.525863 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:38.525700    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" event={"ID":"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754","Type":"ContainerDied","Data":"9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680"}
Jul 11 04:13:38.526141 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:38.526126    2558 scope.go:117] "RemoveContainer" containerID="9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680"
Jul 11 04:13:38.527122 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:38.527093    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:13:38.527226 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:38.527163    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:13:38.527226 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:38.527196    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:13:39.537927 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:39.537893    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" event={"ID":"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754","Type":"ContainerStarted","Data":"7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204"}
Jul 11 04:13:39.627937 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:39.627894    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:39.628138 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:39.628018    2558 patch_prober.go:28] interesting pod/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:13:39.628138 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:39.628061    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 11 04:13:40.627590 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:40.627541    2558 patch_prober.go:28] interesting pod/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:13:40.628161 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:40.627621    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 11 04:13:41.627423 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:41.627379    2558 patch_prober.go:28] interesting pod/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:13:41.627639 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:41.627455    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 11 04:13:42.632379 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:42.632339    2558 patch_prober.go:28] interesting pod/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:13:42.632927 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:42.632408    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 11 04:13:43.631325 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:43.631244    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:43.631661 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:43.631642    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:13:43.632430 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:13:43.632409    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:14:26.914408 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:26.914363    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:31.608689 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:31.608653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:37.145253 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:37.145217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:37.209052 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:37.209012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:41.787644 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:41.787604    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"]
Jul 11 04:14:41.788103 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:41.787838    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy" containerID="cri-o://7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204" gracePeriod=30
Jul 11 04:14:41.809616 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:41.809578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:42.168997 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:42.168960    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:42.269468 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:42.269434    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:42.378088 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:42.378058    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:43.633832 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:43.633780    2558 patch_prober.go:28] interesting pod/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 04:14:43.634232 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:43.633857    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 04:14:43.668208 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:43.668178    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:43.891070 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:43.890982    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:44.091922 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:44.091890    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:44.306058 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:44.305974    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:44.412271 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:44.412231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:47.056294 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.056225    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:14:47.145396 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145364    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zcg9\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-kube-api-access-4zcg9\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145515 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145421    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-credential-socket\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145515 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145447    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istiod-ca-cert\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145515 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-certs\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145515 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145488    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-socket\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145730 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145527    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-token\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145730 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145570    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-envoy\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145730 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145610    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-data\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145730 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145680    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-podinfo\") pod \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\" (UID: \"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754\") "
Jul 11 04:14:47.145969 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145924    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:14:47.145969 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.145935    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:14:47.146073 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.146027    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.146073 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.146045    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.146341 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.146317    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:14:47.146576 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.146556    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:14:47.147036 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.147010    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-data" (OuterVolumeSpecName: "istio-data") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:14:47.147856 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.147833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-kube-api-access-4zcg9" (OuterVolumeSpecName: "kube-api-access-4zcg9") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "kube-api-access-4zcg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:14:47.148075 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.148054    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:14:47.148277 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.148261    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:14:47.148445 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.148418    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-token" (OuterVolumeSpecName: "istio-token") pod "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" (UID: "c639cd4a-21c1-4499-8ce4-a5b8fd7a1754"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:14:47.246653 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.246621    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.246653 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.246648    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.246653 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.246658    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zcg9\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-kube-api-access-4zcg9\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.246934 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.246668    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.246934 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.246677    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.246934 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.246685    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.246934 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.246694    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:14:47.889748 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.889710    2558 generic.go:356] "Generic (PLEG): container finished" podID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerID="7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204" exitCode=0
Jul 11 04:14:47.889948 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.889761    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"
Jul 11 04:14:47.889948 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.889813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" event={"ID":"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754","Type":"ContainerDied","Data":"7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204"}
Jul 11 04:14:47.889948 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.889869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst" event={"ID":"c639cd4a-21c1-4499-8ce4-a5b8fd7a1754","Type":"ContainerDied","Data":"8531810afb7e71f40ac79b989f18a6fe06ba64ac555c898f48a573f16fb75aec"}
Jul 11 04:14:47.889948 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.889893    2558 scope.go:117] "RemoveContainer" containerID="7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204"
Jul 11 04:14:47.899468 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.899450    2558 scope.go:117] "RemoveContainer" containerID="9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680"
Jul 11 04:14:47.907426 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.907398    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"]
Jul 11 04:14:47.909954 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.909765    2558 scope.go:117] "RemoveContainer" containerID="7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204"
Jul 11 04:14:47.910151 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:14:47.910129    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204\": container with ID starting with 7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204 not found: ID does not exist" containerID="7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204"
Jul 11 04:14:47.910208 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.910160    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204"} err="failed to get container status \"7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204\": rpc error: code = NotFound desc = could not find container \"7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204\": container with ID starting with 7718fa1b3892b290920bd3e1475c3896b9b9e22986d3a625d8d0cc24e5fae204 not found: ID does not exist"
Jul 11 04:14:47.910208 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.910179    2558 scope.go:117] "RemoveContainer" containerID="9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680"
Jul 11 04:14:47.910482 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:14:47.910462    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680\": container with ID starting with 9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680 not found: ID does not exist" containerID="9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680"
Jul 11 04:14:47.910598 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.910485    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680"} err="failed to get container status \"9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680\": rpc error: code = NotFound desc = could not find container \"9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680\": container with ID starting with 9005c1013337c2bb95acb1a7f8bd1dc23281526b2c6e386dd1906ad652fbb680 not found: ID does not exist"
Jul 11 04:14:47.911174 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:47.911157    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9ed97a74-openshift-default-698d864f87-6shst"]
Jul 11 04:14:48.415197 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:48.415158    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:48.515543 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:48.515510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:14:49.541224 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:49.541188    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" path="/var/lib/kubelet/pods/c639cd4a-21c1-4499-8ce4-a5b8fd7a1754/volumes"
Jul 11 04:14:52.017489 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:14:52.017456    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:48.245769 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:48.245737    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:49.322704 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:49.322671    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:53.947858 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:53.947824    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:54.220876 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:54.220778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:54.809840 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:54.809797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:59.618012 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:59.617972    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:59.669717 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:59.669680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:59.831274 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:59.831240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:15:59.890410 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:15:59.890325    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:00.934536 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:00.934503    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:01.005474 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:01.005443    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:01.080718 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:01.080684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:01.411288 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:01.411250    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:01.670161 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:01.670065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:01.771635 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:01.771602    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:02.915435 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:02.915396    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:13.008544 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:13.008501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:13.109762 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:13.109727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:23.205110 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:23.205074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:16:23.305943 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:16:23.305906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:16.658463 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:16.658370    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:21.161931 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:21.161893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:26.772872 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:26.772835    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:26.875897 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:26.875849    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:32.163725 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:32.163691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:32.444276 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:32.444240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:33.543228 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:33.543171    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:33.624233 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:33.624178    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:33.692113 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:33.692082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:33.762545 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:33.762513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:34.188019 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:34.187985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:34.290035 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:34.289977    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:38.703050 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:38.703012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:38.803637 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:38.803603    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:42.221192 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:42.221161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:17:44.887104 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:17:44.887068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:18:21.669698 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:18:21.669667    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:18:21.675676 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:18:21.675649    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:18:48.380496 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:18:48.380463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:18:51.716220 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:18:51.716185    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:18:53.085292 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:18:53.085257    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:18:58.602768 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:18:58.602731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:18:58.658991 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:18:58.658954    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:03.314178 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:03.314141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:03.854545 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:03.854509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:03.960252 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:03.960222    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:04.054259 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:04.054225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:05.449410 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:05.449348    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:09.840570 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:09.840524    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:11.319656 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:11.319621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:11.474171 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:11.474129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:11.552969 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:11.552939    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:11.655019 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:11.654985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:12.037014 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:12.036925    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:37.992050 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:37.992010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:43.716599 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:43.716510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:43.777507 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:43.777469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:43.854407 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:43.854373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:43.954145 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:43.954108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:19:59.788006 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:19:59.787969    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:05.424779 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:05.424743    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:05.478254 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:05.478217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:05.557228 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:05.557195    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:05.653773 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:05.653736    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:16.137338 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:16.137300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:16.953281 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:16.953240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:22.659963 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:22.659921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:22.716576 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:22.716525    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:22.773483 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:22.773444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:22.877849 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:22.877797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:22.978770 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:22.978682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:23.705382 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:23.705349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:23.806157 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:23.806128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:23.905772 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:23.905724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:25.477929 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:25.477894    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:31.187415 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:31.187379    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:31.288372 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:31.288336    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:31.863219 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:31.863181    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:37.585946 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:37.585902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:37.652054 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:37.652022    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:37.826984 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:37.826937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:38.165023 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:38.164995    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:38.679200 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:38.679168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:40.954819 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:40.954769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:41.038845 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:41.038781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:41.100515 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:41.100483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:41.682897 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:41.682864    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:41.784928 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:41.784892    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:41.938905 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:41.938812    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:45.456516 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:45.456484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:46.111511 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:46.111464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:46.209963 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:46.209930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:46.536017 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:46.535928    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:52.197509 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:52.197475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:20:53.547098 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:20:53.547062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:02.934710 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:02.934667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:07.619310 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:07.619273    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:10.236768 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:10.236732    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:13.234581 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:13.234544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:13.295423 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:13.295393    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:13.801269 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:13.801220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:13.901925 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:13.901884    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:18.277439 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:18.277405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:18.513534 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:18.513502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:18.628505 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:18.628473    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:18.729151 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:18.729114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:18.845847 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:18.845787    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:24.387691 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:24.387649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:24.444012 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:24.443979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:24.528918 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:24.528879    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:24.629741 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:24.629708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:24.728173 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:24.728094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:30.233957 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:30.233893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:30.290692 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:30.290659    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:37.124723 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:37.124685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:37.542567 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:37.542456    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:37.655853 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:37.655813    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:40.341964 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:40.341927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:40.418227 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:40.418195    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:40.485660 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:40.485620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:40.926311 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:40.926280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:41.033151 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:41.033111    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:41.153303 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:41.153265    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:44.814224 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:44.814187    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:21:51.270773 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:21:51.270734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:22:23.369370 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:22:23.369330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:22:27.959839 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:22:27.959783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:22:32.986377 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:22:32.986341    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:09.234473 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:09.234428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:09.831651 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:09.831616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:15.280669 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:15.280627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:20.816595 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:20.816559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:20.872965 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:20.872932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:21.701267 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:21.701234    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:23:21.709442 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:21.709415    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:23:30.277316 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:30.277284    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:30.528738 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:30.528645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:31.624667 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:31.624630    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:31.716359 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:31.716326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:31.813931 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:31.813896    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:32.574620 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:32.574579    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:32.671198 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:32.671168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:32.772411 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:32.772375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:34.307514 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:34.307481    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:40.123687 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:40.123652    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:40.186116 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:40.186080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:40.840632 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:40.840598    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:46.362015 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:46.361972    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:46.422451 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:46.422418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:46.494603 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:46.494572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:46.598084 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:46.598051    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:57.077987 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:57.077947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:23:57.405129 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:23:57.405088    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:13.876313 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:13.876233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:13.922237 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:13.922202    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:18.328560 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:18.328521    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:23.922542 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:23.922507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:24.023534 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:24.023501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:24.269127 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:24.269042    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:24.556045 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:24.555966    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:24.790218 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:24.790175    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:27.251579 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:27.251542    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:27.331538 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:27.331506    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:27.392670 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:27.392630    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:27.650372 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:27.650334    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:27.874175 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:27.874144    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:27.984170 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:27.984069    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:31.742096 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:31.742061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:32.094533 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.094452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:32.359835 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.359781    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"]
Jul 11 04:24:32.360220 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.360207    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy"
Jul 11 04:24:32.360291 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.360221    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy"
Jul 11 04:24:32.360346 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.360304    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy"
Jul 11 04:24:32.360346 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.360312    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy"
Jul 11 04:24:32.363636 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.363612    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.366373 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.366343    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6c0c56-openshift-default-dockercfg-qpkcz\""
Jul 11 04:24:32.375113 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.375087    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"]
Jul 11 04:24:32.389849 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.389788    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:32.458330 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55q6h\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-kube-api-access-55q6h\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458550 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-token\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458550 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-credential-socket\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458550 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ae6c24-f1cd-4c1c-9928-b417708db40f-istiod-ca-cert\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458732 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-data\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458732 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-socket\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458732 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-certs\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458732 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-envoy\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.458732 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.458703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-podinfo\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559284 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-socket\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559470 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-certs\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559470 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559320    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-envoy\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559470 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-podinfo\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559470 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55q6h\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-kube-api-access-55q6h\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559470 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-token\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559743 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559475    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-credential-socket\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559743 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ae6c24-f1cd-4c1c-9928-b417708db40f-istiod-ca-cert\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559743 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-data\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.559743 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.559675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-socket\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.560099 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.560071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-certs\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.560239 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.560199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-data\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.560325 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.560295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-credential-socket\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.560325 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.560311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ae6c24-f1cd-4c1c-9928-b417708db40f-istiod-ca-cert\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.562061 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.562034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-podinfo\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.562269 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.562249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-envoy\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.567241 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.567218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-token\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.567426 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.567405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55q6h\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-kube-api-access-55q6h\") pod \"e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") " pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.676812 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.676702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:32.735674 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.735626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:32.824995 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.824966    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"]
Jul 11 04:24:32.826648 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:24:32.826621    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ae6c24_f1cd_4c1c_9928_b417708db40f.slice/crio-98c2bd4c0e633650e960625966fc3cecfb1a315a5382dc9e07a9013f14e3959d WatchSource:0}: Error finding container 98c2bd4c0e633650e960625966fc3cecfb1a315a5382dc9e07a9013f14e3959d: Status 404 returned error can't find the container with id 98c2bd4c0e633650e960625966fc3cecfb1a315a5382dc9e07a9013f14e3959d
Jul 11 04:24:32.828932 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.828898    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:24:32.829012 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.828965    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:24:32.829052 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.829012    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:24:32.888666 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:32.888633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" event={"ID":"76ae6c24-f1cd-4c1c-9928-b417708db40f","Type":"ContainerStarted","Data":"98c2bd4c0e633650e960625966fc3cecfb1a315a5382dc9e07a9013f14e3959d"}
Jul 11 04:24:33.895717 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:33.895677    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" event={"ID":"76ae6c24-f1cd-4c1c-9928-b417708db40f","Type":"ContainerStarted","Data":"6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f"}
Jul 11 04:24:33.915203 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:33.915134    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" podStartSLOduration=1.9151156870000001 podStartE2EDuration="1.915115687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:24:33.913169138 +0000 UTC m=+2172.996771495" watchObservedRunningTime="2026-07-11 04:24:33.915115687 +0000 UTC m=+2172.998717999"
Jul 11 04:24:34.677182 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:34.677138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:34.682242 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:34.682217    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:34.901399 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:34.901358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:34.902613 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:34.902588    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:35.792016 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:35.791979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:35.872084 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:35.872023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:35.936084 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:35.936025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:36.036420 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:36.036387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:36.371219 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:36.371185    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:36.478111 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:36.478025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:40.307690 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:40.307648    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:48.734415 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:48.734375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:48.837681 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:48.837649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:49.903092 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.903059    2558 patch_prober.go:28] interesting pod/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 11 04:24:49.903527 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.903118    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 11 04:24:49.977546 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.977512    2558 generic.go:356] "Generic (PLEG): container finished" podID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerID="6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f" exitCode=0
Jul 11 04:24:49.977721 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.977598    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" event={"ID":"76ae6c24-f1cd-4c1c-9928-b417708db40f","Type":"ContainerDied","Data":"6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f"}
Jul 11 04:24:49.978053 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.978038    2558 scope.go:117] "RemoveContainer" containerID="6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f"
Jul 11 04:24:49.979131 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.979098    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:24:49.979259 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.979183    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:24:49.979259 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:49.979231    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:24:50.984575 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:50.984529    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" event={"ID":"76ae6c24-f1cd-4c1c-9928-b417708db40f","Type":"ContainerStarted","Data":"9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c"}
Jul 11 04:24:51.677355 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:51.677316    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:51.677561 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:51.677539    2558 patch_prober.go:28] interesting pod/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 11 04:24:51.677609 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:51.677587    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 11 04:24:52.677479 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:52.677442    2558 patch_prober.go:28] interesting pod/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 11 04:24:52.677908 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:52.677508    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 11 04:24:53.677594 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:53.677552    2558 patch_prober.go:28] interesting pod/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 11 04:24:53.678051 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:53.677629    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 11 04:24:54.677354 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:54.677314    2558 patch_prober.go:28] interesting pod/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 11 04:24:54.677543 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:54.677386    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 11 04:24:55.107581 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:55.107546    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:55.681886 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:55.681855    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:55.682137 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:55.682116    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:55.682833 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:55.682816    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:24:58.025447 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:58.025411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:24:58.130764 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:24:58.130731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:16.204594 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:16.204547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:33.640582 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:33.640531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:34.637266 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:34.637234    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:35.303734 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:35.303692    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:35.405269 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:35.405228    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:45.114086 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:45.114005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:49.815630 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:49.815590    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:55.516886 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:55.516845    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:25:56.818078 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:25:56.818037    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:00.490008 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:00.489973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:00.720527 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:00.720499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:01.355362 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:01.355322    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:01.455961 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:01.455935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:03.937500 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:03.937461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:11.229373 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:11.229327    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:13.597786 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:13.597754    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:14.668281 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:14.668242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:14.769670 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:14.769630    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:15.893203 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:15.893173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:21.525035 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:21.525002    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:21.580618 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:21.580586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:26.528591 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:26.528541    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"]
Jul 11 04:26:26.529213 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:26.528760    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy" containerID="cri-o://9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c" gracePeriod=30
Jul 11 04:26:26.548280 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:26.548254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:26.783654 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:26.783564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:27.109101 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:27.109065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:27.418871 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:27.418761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:28.145117 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:28.145086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:30.002790 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:30.002755    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:30.079173 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:30.079141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:30.142516 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:30.142481    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:30.623455 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:30.623422    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:30.725224 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:30.725189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:30.823690 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:30.823641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:31.796878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.796814    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:26:31.862751 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.862718    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-data\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.862975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.862766    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-credential-socket\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.862975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.862785    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-podinfo\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.862975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.862853    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ae6c24-f1cd-4c1c-9928-b417708db40f-istiod-ca-cert\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.862975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.862885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-token\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.862975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.862918    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-socket\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.862975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.862948    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-envoy\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.863294 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.863024    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-certs\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.863294 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.863070    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55q6h\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-kube-api-access-55q6h\") pod \"76ae6c24-f1cd-4c1c-9928-b417708db40f\" (UID: \"76ae6c24-f1cd-4c1c-9928-b417708db40f\") "
Jul 11 04:26:31.863402 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.863062    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:31.863402 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.863214    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:31.863402 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.863259    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76ae6c24-f1cd-4c1c-9928-b417708db40f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:26:31.863560 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.863457    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:31.863755 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.863727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-data" (OuterVolumeSpecName: "istio-data") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:31.865274 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.865245    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:26:31.865274 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.865261    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-kube-api-access-55q6h" (OuterVolumeSpecName: "kube-api-access-55q6h") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "kube-api-access-55q6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:26:31.865515 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.865493    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:31.865625 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.865509    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-token" (OuterVolumeSpecName: "istio-token") pod "76ae6c24-f1cd-4c1c-9928-b417708db40f" (UID: "76ae6c24-f1cd-4c1c-9928-b417708db40f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:26:31.963896 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963852    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.963896 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963891    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.963896 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963901    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.963896 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963909    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.964182 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963917    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55q6h\" (UniqueName: \"kubernetes.io/projected/76ae6c24-f1cd-4c1c-9928-b417708db40f-kube-api-access-55q6h\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.964182 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963927    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.964182 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963934    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ae6c24-f1cd-4c1c-9928-b417708db40f-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.964182 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963944    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ae6c24-f1cd-4c1c-9928-b417708db40f-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:31.964182 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:31.963953    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ae6c24-f1cd-4c1c-9928-b417708db40f-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:26:32.538330 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.538290    2558 generic.go:356] "Generic (PLEG): container finished" podID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerID="9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c" exitCode=0
Jul 11 04:26:32.538514 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.538344    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"
Jul 11 04:26:32.538514 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.538375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" event={"ID":"76ae6c24-f1cd-4c1c-9928-b417708db40f","Type":"ContainerDied","Data":"9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c"}
Jul 11 04:26:32.538514 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.538425    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n" event={"ID":"76ae6c24-f1cd-4c1c-9928-b417708db40f","Type":"ContainerDied","Data":"98c2bd4c0e633650e960625966fc3cecfb1a315a5382dc9e07a9013f14e3959d"}
Jul 11 04:26:32.538514 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.538447    2558 scope.go:117] "RemoveContainer" containerID="9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c"
Jul 11 04:26:32.548121 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.548100    2558 scope.go:117] "RemoveContainer" containerID="6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f"
Jul 11 04:26:32.556723 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.556700    2558 scope.go:117] "RemoveContainer" containerID="9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c"
Jul 11 04:26:32.556986 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:26:32.556965    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c\": container with ID starting with 9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c not found: ID does not exist" containerID="9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c"
Jul 11 04:26:32.557057 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.556994    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c"} err="failed to get container status \"9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c\": rpc error: code = NotFound desc = could not find container \"9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c\": container with ID starting with 9f69affe1deee04d43ba0a4163191085d2758b26d169af4cbb16dd9dcfcfe95c not found: ID does not exist"
Jul 11 04:26:32.557057 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.557012    2558 scope.go:117] "RemoveContainer" containerID="6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f"
Jul 11 04:26:32.557229 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:26:32.557212    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f\": container with ID starting with 6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f not found: ID does not exist" containerID="6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f"
Jul 11 04:26:32.557278 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.557232    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f"} err="failed to get container status \"6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f\": rpc error: code = NotFound desc = could not find container \"6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f\": container with ID starting with 6b243c74cb52857d72345d03e61bf95bf3595dcfa45023e32818ca26a9ffb42f not found: ID does not exist"
Jul 11 04:26:32.560734 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.560709    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"]
Jul 11 04:26:32.565974 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:32.565956    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6c0c56-openshift-default-5cd9c466fc-d6x5n"]
Jul 11 04:26:33.538714 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:33.538682    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" path="/var/lib/kubelet/pods/76ae6c24-f1cd-4c1c-9928-b417708db40f/volumes"
Jul 11 04:26:34.486628 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:34.486596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:34.932767 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:34.932724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:35.201974 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.201882    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"]
Jul 11 04:26:35.202517 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.202500    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy"
Jul 11 04:26:35.202615 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.202519    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy"
Jul 11 04:26:35.202615 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.202539    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy"
Jul 11 04:26:35.202615 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.202548    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c639cd4a-21c1-4499-8ce4-a5b8fd7a1754" containerName="istio-proxy"
Jul 11 04:26:35.202767 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.202645    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy"
Jul 11 04:26:35.207612 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.207585    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.210083 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.210061    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a8084b-openshift-default-dockercfg-llncd\""
Jul 11 04:26:35.215121 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.215096    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"]
Jul 11 04:26:35.227790 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.227757    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:35.292382 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292330    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-credential-socket\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292382 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-data\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292696 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-envoy\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292696 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-socket\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292696 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-certs\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292696 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-istio-token\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292696 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/554a5932-14d2-4d33-9b57-2693befae4ec-istiod-ca-cert\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292696 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j7qm\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-kube-api-access-9j7qm\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.292985 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.292704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/554a5932-14d2-4d33-9b57-2693befae4ec-istio-podinfo\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394223 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-credential-socket\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394223 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394230    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-data\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-envoy\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-socket\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-certs\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394665 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394512    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-istio-token\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394665 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/554a5932-14d2-4d33-9b57-2693befae4ec-istiod-ca-cert\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394665 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j7qm\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-kube-api-access-9j7qm\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394665 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/554a5932-14d2-4d33-9b57-2693befae4ec-istio-podinfo\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394665 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-credential-socket\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.394950 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.394680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-data\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.395044 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.395021    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-certs\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.395339 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.395269    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:35.395339 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.395327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-socket\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.395465 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.395406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/554a5932-14d2-4d33-9b57-2693befae4ec-istiod-ca-cert\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.397042 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.397022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-envoy\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.397151 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.397134    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/554a5932-14d2-4d33-9b57-2693befae4ec-istio-podinfo\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.402322 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.402300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j7qm\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-kube-api-access-9j7qm\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.402595 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.402571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-istio-token\") pod \"e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") " pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.521354 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.521273    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:35.664407 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.664376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"]
Jul 11 04:26:35.665757 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:26:35.665733    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554a5932_14d2_4d33_9b57_2693befae4ec.slice/crio-7dc0414f5729356916e58bdc744dcb9021f2a41051d32070cb6ef63486734102 WatchSource:0}: Error finding container 7dc0414f5729356916e58bdc744dcb9021f2a41051d32070cb6ef63486734102: Status 404 returned error can't find the container with id 7dc0414f5729356916e58bdc744dcb9021f2a41051d32070cb6ef63486734102
Jul 11 04:26:35.667965 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.667931    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:26:35.668047 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.667998    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:26:35.668047 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:35.668025    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:26:36.559029 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:36.558992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" event={"ID":"554a5932-14d2-4d33-9b57-2693befae4ec","Type":"ContainerStarted","Data":"9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf"}
Jul 11 04:26:36.559456 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:36.559047    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" event={"ID":"554a5932-14d2-4d33-9b57-2693befae4ec","Type":"ContainerStarted","Data":"7dc0414f5729356916e58bdc744dcb9021f2a41051d32070cb6ef63486734102"}
Jul 11 04:26:36.579283 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:36.579233    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" podStartSLOduration=1.579217341 podStartE2EDuration="1.579217341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:26:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:26:36.577206463 +0000 UTC m=+2295.660808777" watchObservedRunningTime="2026-07-11 04:26:36.579217341 +0000 UTC m=+2295.662819653"
Jul 11 04:26:37.522137 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:37.522098    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:37.527177 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:37.527149    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:37.564942 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:37.564910    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:37.565756 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:37.565735    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:38.476513 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:38.476477    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:38.549487 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:38.549453    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:38.617167 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:38.617132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:38.955694 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:38.955657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:39.136324 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:39.136290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:39.237488 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:39.237400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:42.957169 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:42.957139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:51.473944 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:51.473905    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:51.576550 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:51.576515    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:52.565078 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:52.565033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:26:53.607255 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.605956    2558 patch_prober.go:28] interesting pod/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 11 04:26:53.607255 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.606043    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 11 04:26:53.661068 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.661033    2558 generic.go:356] "Generic (PLEG): container finished" podID="554a5932-14d2-4d33-9b57-2693befae4ec" containerID="9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf" exitCode=0
Jul 11 04:26:53.661238 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.661107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" event={"ID":"554a5932-14d2-4d33-9b57-2693befae4ec","Type":"ContainerDied","Data":"9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf"}
Jul 11 04:26:53.661583 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.661568    2558 scope.go:117] "RemoveContainer" containerID="9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf"
Jul 11 04:26:53.662663 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.662633    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:26:53.662769 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.662709    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:26:53.662769 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:53.662742    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:26:54.669201 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:54.669164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" event={"ID":"554a5932-14d2-4d33-9b57-2693befae4ec","Type":"ContainerStarted","Data":"5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09"}
Jul 11 04:26:55.522107 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:55.522056    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:55.522391 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:55.522363    2558 patch_prober.go:28] interesting pod/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 11 04:26:55.522492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:55.522427    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 11 04:26:56.522591 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:56.522541    2558 patch_prober.go:28] interesting pod/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 11 04:26:56.523128 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:56.522615    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 11 04:26:57.522440 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:57.522388    2558 patch_prober.go:28] interesting pod/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 11 04:26:57.522772 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:57.522466    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 11 04:26:58.524989 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:58.524955    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:58.525384 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:58.525218    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:26:58.525862 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:26:58.525795    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:27:00.807689 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:00.807652    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:00.908657 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:00.908621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:01.425494 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:01.425452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:06.118492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:06.118456    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:09.414121 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:09.414083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:09.548869 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:09.548834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:11.818403 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:11.818367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:11.876082 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:11.876048    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:16.789761 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:16.789680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:17.018015 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:17.017980    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:27.534135 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:27.534086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:32.215330 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:32.215278    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:37.930322 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:37.930268    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:37.989745 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:37.989704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:42.937903 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:42.937867    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"]
Jul 11 04:27:42.938338 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:42.938098    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy" containerID="cri-o://5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09" gracePeriod=30
Jul 11 04:27:42.957443 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:42.957406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:43.185169 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:43.185131    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:43.515701 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:43.515657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:43.527707 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:43.527674    2558 patch_prober.go:28] interesting pod/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 11 04:27:43.527889 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:43.527732    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 04:27:43.819520 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:43.819431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:43.962247 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:43.962205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:46.445615 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:46.445578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:46.528586 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:46.528547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:46.601170 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:46.601136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:46.702091 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:46.701987    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:47.069237 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:47.069152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:47.174831 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:47.174772    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:48.209627 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.209552    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:27:48.311338 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-socket\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311529 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311369    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-data\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311529 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311399    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-certs\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311529 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311431    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/554a5932-14d2-4d33-9b57-2693befae4ec-istio-podinfo\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311529 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311457    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-envoy\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311529 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311522    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/554a5932-14d2-4d33-9b57-2693befae4ec-istiod-ca-cert\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311751 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311605    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-credential-socket\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311751 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311634    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:48.311751 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311646    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j7qm\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-kube-api-access-9j7qm\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.311751 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.311730    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-istio-token\") pod \"554a5932-14d2-4d33-9b57-2693befae4ec\" (UID: \"554a5932-14d2-4d33-9b57-2693befae4ec\") "
Jul 11 04:27:48.312128 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.312029    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:48.312128 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.312114    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.312271 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.312133    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.312271 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.312216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:48.312271 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.312245    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/554a5932-14d2-4d33-9b57-2693befae4ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:27:48.312453 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.312287    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:48.313961 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.313927    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/554a5932-14d2-4d33-9b57-2693befae4ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:27:48.314143 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.314119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:48.314233 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.314218    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-kube-api-access-9j7qm" (OuterVolumeSpecName: "kube-api-access-9j7qm") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "kube-api-access-9j7qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:27:48.314338 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.314321    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "554a5932-14d2-4d33-9b57-2693befae4ec" (UID: "554a5932-14d2-4d33-9b57-2693befae4ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:27:48.412745 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.412708    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.412745 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.412736    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j7qm\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-kube-api-access-9j7qm\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.412745 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.412746    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/554a5932-14d2-4d33-9b57-2693befae4ec-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.412998 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.412756    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.412998 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.412765    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/554a5932-14d2-4d33-9b57-2693befae4ec-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.412998 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.412773    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/554a5932-14d2-4d33-9b57-2693befae4ec-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.412998 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.412781    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/554a5932-14d2-4d33-9b57-2693befae4ec-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:27:48.968583 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.968539    2558 generic.go:356] "Generic (PLEG): container finished" podID="554a5932-14d2-4d33-9b57-2693befae4ec" containerID="5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09" exitCode=0
Jul 11 04:27:48.968767 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.968595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" event={"ID":"554a5932-14d2-4d33-9b57-2693befae4ec","Type":"ContainerDied","Data":"5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09"}
Jul 11 04:27:48.968767 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.968605    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"
Jul 11 04:27:48.968767 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.968652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6" event={"ID":"554a5932-14d2-4d33-9b57-2693befae4ec","Type":"ContainerDied","Data":"7dc0414f5729356916e58bdc744dcb9021f2a41051d32070cb6ef63486734102"}
Jul 11 04:27:48.968767 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.968682    2558 scope.go:117] "RemoveContainer" containerID="5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09"
Jul 11 04:27:48.978232 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.978213    2558 scope.go:117] "RemoveContainer" containerID="9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf"
Jul 11 04:27:48.986334 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.986317    2558 scope.go:117] "RemoveContainer" containerID="5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09"
Jul 11 04:27:48.986607 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:27:48.986588    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09\": container with ID starting with 5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09 not found: ID does not exist" containerID="5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09"
Jul 11 04:27:48.986646 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.986617    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09"} err="failed to get container status \"5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09\": rpc error: code = NotFound desc = could not find container \"5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09\": container with ID starting with 5b0133ada9b2a68025d0f8adef8b2598e322b2e29e9c3321c3dcf763a306df09 not found: ID does not exist"
Jul 11 04:27:48.986646 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.986633    2558 scope.go:117] "RemoveContainer" containerID="9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf"
Jul 11 04:27:48.986898 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:27:48.986872    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf\": container with ID starting with 9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf not found: ID does not exist" containerID="9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf"
Jul 11 04:27:48.987021 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.986906    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf"} err="failed to get container status \"9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf\": rpc error: code = NotFound desc = could not find container \"9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf\": container with ID starting with 9a557c95609ae5c2c93c421cbd5a5cd212ccf51ee729a3ab057fb9d2046e1edf not found: ID does not exist"
Jul 11 04:27:48.989599 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.989574    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"]
Jul 11 04:27:48.993768 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:48.993746    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a8084b-openshift-default-547bbcf655-47hl6"]
Jul 11 04:27:49.538315 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:49.538280    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" path="/var/lib/kubelet/pods/554a5932-14d2-4d33-9b57-2693befae4ec/volumes"
Jul 11 04:27:50.954561 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:50.954522    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:51.288103 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.288012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:51.662559 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.662521    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"]
Jul 11 04:27:51.662978 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.662964    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy"
Jul 11 04:27:51.663030 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.662980    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy"
Jul 11 04:27:51.663030 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.662999    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy"
Jul 11 04:27:51.663030 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.663004    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy"
Jul 11 04:27:51.663030 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.663023    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy"
Jul 11 04:27:51.663166 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.663032    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy"
Jul 11 04:27:51.663166 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.663101    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy"
Jul 11 04:27:51.663166 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.663116    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ae6c24-f1cd-4c1c-9928-b417708db40f" containerName="istio-proxy"
Jul 11 04:27:51.667623 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.667603    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.671033 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.671011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-eefca5-openshift-default-dockercfg-7klgt\""
Jul 11 04:27:51.691408 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.691380    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"]
Jul 11 04:27:51.706628 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.706586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:51.844080 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-certs\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844286 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72r6v\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-kube-api-access-72r6v\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844286 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istiod-ca-cert\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844286 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-credential-socket\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844286 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-data\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844286 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-podinfo\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844596 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-token\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844596 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-socket\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.844596 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.844402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-envoy\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.857032 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.856995    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:51.945588 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-data\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945588 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-podinfo\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-token\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-socket\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-envoy\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945708    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-certs\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72r6v\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-kube-api-access-72r6v\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istiod-ca-cert\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.945878 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.945790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-credential-socket\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.946241 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.946099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-socket\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.946241 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.946116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-certs\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.946337 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.946265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-credential-socket\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.946337 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.946281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-data\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.946749 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.946724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istiod-ca-cert\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.948188 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.948166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-envoy\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.948410 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.948393    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-podinfo\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.953307 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.953281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-token\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.953412 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.953383    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72r6v\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-kube-api-access-72r6v\") pod \"e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") " pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:51.979436 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:51.979407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:52.129613 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:52.129587    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"]
Jul 11 04:27:52.131965 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:27:52.131934    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b78cced_28ff_4ca7_87e1_854cc9eaff93.slice/crio-6699dbd0f7a500521b9d1bf0820d9823fd86c936c9fbdc87f9eb7a7442fcaab9 WatchSource:0}: Error finding container 6699dbd0f7a500521b9d1bf0820d9823fd86c936c9fbdc87f9eb7a7442fcaab9: Status 404 returned error can't find the container with id 6699dbd0f7a500521b9d1bf0820d9823fd86c936c9fbdc87f9eb7a7442fcaab9
Jul 11 04:27:52.134218 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:52.134178    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:27:52.134328 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:52.134265    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:27:52.134328 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:52.134308    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:27:52.995699 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:52.995662    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" event={"ID":"8b78cced-28ff-4ca7-87e1-854cc9eaff93","Type":"ContainerStarted","Data":"b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5"}
Jul 11 04:27:52.996237 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:52.995720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" event={"ID":"8b78cced-28ff-4ca7-87e1-854cc9eaff93","Type":"ContainerStarted","Data":"6699dbd0f7a500521b9d1bf0820d9823fd86c936c9fbdc87f9eb7a7442fcaab9"}
Jul 11 04:27:53.016997 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:53.016943    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" podStartSLOduration=2.016926879 podStartE2EDuration="2.016926879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:27:53.014530623 +0000 UTC m=+2372.098132926" watchObservedRunningTime="2026-07-11 04:27:53.016926879 +0000 UTC m=+2372.100529191"
Jul 11 04:27:53.980146 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:53.980100    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:53.985326 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:53.985294    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:54.009067 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:54.009030    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:54.010140 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:54.010111    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:27:54.892688 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:54.892653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:54.992006 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:54.991967    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:55.103062 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:55.103023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:55.281088 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:55.281006    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:55.519736 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:55.519700    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:55.617928 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:55.617898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:27:59.379282 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:27:59.379242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:28:07.104331 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:07.104291    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerID="b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5" exitCode=0
Jul 11 04:28:07.104932 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:07.104367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" event={"ID":"8b78cced-28ff-4ca7-87e1-854cc9eaff93","Type":"ContainerDied","Data":"b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5"}
Jul 11 04:28:07.104932 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:07.104741    2558 scope.go:117] "RemoveContainer" containerID="b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5"
Jul 11 04:28:07.105748 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:07.105721    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:28:07.105840 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:07.105788    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:28:07.105908 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:07.105849    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 04:28:08.115502 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:08.115461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" event={"ID":"8b78cced-28ff-4ca7-87e1-854cc9eaff93","Type":"ContainerStarted","Data":"c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e"}
Jul 11 04:28:08.662265 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:08.662223    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:28:08.762830 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:08.762785    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:28:08.980647 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:08.980546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:28:08.981734 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:08.981696    2558 patch_prober.go:28] interesting pod/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 11 04:28:08.981890 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:08.981779    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 11 04:28:09.009303 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:09.009261    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:28:09.980514 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:09.980478    2558 patch_prober.go:28] interesting pod/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 11 04:28:09.980949 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:09.980538    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 11 04:28:10.980736 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:10.980700    2558 patch_prober.go:28] interesting pod/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 11 04:28:10.981168 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:10.980762    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 11 04:28:11.984464 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:11.984433    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:28:11.985596 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:11.985576    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:28:17.057565 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:17.057524    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:28:17.159341 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:17.159308    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:28:20.519118 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:20.519073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:28:21.735860 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:21.735830    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:28:21.743623 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:21.743598    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:28:43.579883 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:28:43.579743    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:29:36.236965 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:29:36.236921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:29:36.337574 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:29:36.337534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:30:51.192536 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:51.192496    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:30:52.004112 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:52.004047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:30:59.983422 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.983385    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"]
Jul 11 04:30:59.984149 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.984127    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="554a5932-14d2-4d33-9b57-2693befae4ec" containerName="istio-proxy"
Jul 11 04:30:59.987269 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.987247    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:30:59.989779 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.989752    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"default-dockercfg-s5vh7\""
Jul 11 04:30:59.991140 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.991094    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"openshift-service-ca.crt\""
Jul 11 04:30:59.991268 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.991157    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"kube-root-ca.crt\""
Jul 11 04:30:59.991509 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.991483    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3055d9\"/\"sub-test-model-3055d9-kserve-self-signed-certs\""
Jul 11 04:30:59.994520 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:30:59.994496    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"]
Jul 11 04:31:00.002205 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.002178    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:31:00.054940 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.054899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-model-cache\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.055163 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.054999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-dshm\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.055163 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.055097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96fjm\" (UniqueName: \"kubernetes.io/projected/22431d65-b799-41b0-8092-3553bcfeacb1-kube-api-access-96fjm\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.055163 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.055135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22431d65-b799-41b0-8092-3553bcfeacb1-tls-certs\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.055304 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.055208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-home\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.055304 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.055252    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-tmp-dir\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.156517 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.156478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-dshm\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.156704 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.156543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96fjm\" (UniqueName: \"kubernetes.io/projected/22431d65-b799-41b0-8092-3553bcfeacb1-kube-api-access-96fjm\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.156704 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.156577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22431d65-b799-41b0-8092-3553bcfeacb1-tls-certs\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.156704 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.156625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-home\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.156704 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.156660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-tmp-dir\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.156704 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.156692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-model-cache\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.157075 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.157054    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-home\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.157134 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.157094    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-model-cache\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.157134 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.157113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-tmp-dir\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.158781 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.158758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-dshm\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.159072 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.159056    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22431d65-b799-41b0-8092-3553bcfeacb1-tls-certs\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.164920 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.164896    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96fjm\" (UniqueName: \"kubernetes.io/projected/22431d65-b799-41b0-8092-3553bcfeacb1-kube-api-access-96fjm\") pod \"sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") " pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.299073 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.298978    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:00.440719 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:00.440686    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"]
Jul 11 04:31:00.443333 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:31:00.443300    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22431d65_b799_41b0_8092_3553bcfeacb1.slice/crio-41faefcb24837b66ff374b171e50fd2796204cf4974b6ed06faa15b3f23ca696 WatchSource:0}: Error finding container 41faefcb24837b66ff374b171e50fd2796204cf4974b6ed06faa15b3f23ca696: Status 404 returned error can't find the container with id 41faefcb24837b66ff374b171e50fd2796204cf4974b6ed06faa15b3f23ca696
Jul 11 04:31:01.035685 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:01.035643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q" event={"ID":"22431d65-b799-41b0-8092-3553bcfeacb1","Type":"ContainerStarted","Data":"3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9"}
Jul 11 04:31:01.036146 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:01.035695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q" event={"ID":"22431d65-b799-41b0-8092-3553bcfeacb1","Type":"ContainerStarted","Data":"41faefcb24837b66ff374b171e50fd2796204cf4974b6ed06faa15b3f23ca696"}
Jul 11 04:31:01.052184 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:01.052137    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q" podStartSLOduration=2.052122259 podStartE2EDuration="2.052122259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:31:01.050538738 +0000 UTC m=+2560.134141069" watchObservedRunningTime="2026-07-11 04:31:01.052122259 +0000 UTC m=+2560.135724571"
Jul 11 04:31:10.300004 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:10.299959    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:10.300004 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:10.300020    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:10.313307 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:10.313277    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:11.100478 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:11.100449    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:31:15.361095 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:15.361028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:31:15.462005 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:15.461961    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:31:57.418054 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:31:57.417943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:32:16.512274 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:16.512232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:32:33.798284 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:33.798245    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"]
Jul 11 04:32:33.837113 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:33.837080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:32:34.583886 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:34.583856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:32:48.819980 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:48.819937    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q" podUID="22431d65-b799-41b0-8092-3553bcfeacb1" containerName="main" containerID="cri-o://3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9" gracePeriod=45
Jul 11 04:32:49.090761 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.090732    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:32:49.205092 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205056    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-tmp-dir\") pod \"22431d65-b799-41b0-8092-3553bcfeacb1\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") "
Jul 11 04:32:49.205092 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205097    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-model-cache\") pod \"22431d65-b799-41b0-8092-3553bcfeacb1\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") "
Jul 11 04:32:49.205348 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205153    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22431d65-b799-41b0-8092-3553bcfeacb1-tls-certs\") pod \"22431d65-b799-41b0-8092-3553bcfeacb1\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") "
Jul 11 04:32:49.205348 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205175    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-home\") pod \"22431d65-b799-41b0-8092-3553bcfeacb1\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") "
Jul 11 04:32:49.205348 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205199    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-dshm\") pod \"22431d65-b799-41b0-8092-3553bcfeacb1\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") "
Jul 11 04:32:49.205348 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205258    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96fjm\" (UniqueName: \"kubernetes.io/projected/22431d65-b799-41b0-8092-3553bcfeacb1-kube-api-access-96fjm\") pod \"22431d65-b799-41b0-8092-3553bcfeacb1\" (UID: \"22431d65-b799-41b0-8092-3553bcfeacb1\") "
Jul 11 04:32:49.205548 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205390    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "22431d65-b799-41b0-8092-3553bcfeacb1" (UID: "22431d65-b799-41b0-8092-3553bcfeacb1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.205548 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205492    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-model-cache" (OuterVolumeSpecName: "model-cache") pod "22431d65-b799-41b0-8092-3553bcfeacb1" (UID: "22431d65-b799-41b0-8092-3553bcfeacb1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.205548 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205505    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-home" (OuterVolumeSpecName: "home") pod "22431d65-b799-41b0-8092-3553bcfeacb1" (UID: "22431d65-b799-41b0-8092-3553bcfeacb1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.205697 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205646    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-tmp-dir\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.205697 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205667    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-model-cache\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.205697 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.205681    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-home\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.207726 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.207695    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-dshm" (OuterVolumeSpecName: "dshm") pod "22431d65-b799-41b0-8092-3553bcfeacb1" (UID: "22431d65-b799-41b0-8092-3553bcfeacb1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:32:49.207726 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.207703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22431d65-b799-41b0-8092-3553bcfeacb1-kube-api-access-96fjm" (OuterVolumeSpecName: "kube-api-access-96fjm") pod "22431d65-b799-41b0-8092-3553bcfeacb1" (UID: "22431d65-b799-41b0-8092-3553bcfeacb1"). InnerVolumeSpecName "kube-api-access-96fjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:32:49.207974 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.207929    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22431d65-b799-41b0-8092-3553bcfeacb1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "22431d65-b799-41b0-8092-3553bcfeacb1" (UID: "22431d65-b799-41b0-8092-3553bcfeacb1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:32:49.306975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.306933    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96fjm\" (UniqueName: \"kubernetes.io/projected/22431d65-b799-41b0-8092-3553bcfeacb1-kube-api-access-96fjm\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.306975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.306966    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22431d65-b799-41b0-8092-3553bcfeacb1-tls-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.306975 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.306980    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22431d65-b799-41b0-8092-3553bcfeacb1-dshm\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:32:49.605396 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.605357    2558 generic.go:356] "Generic (PLEG): container finished" podID="22431d65-b799-41b0-8092-3553bcfeacb1" containerID="3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9" exitCode=0
Jul 11 04:32:49.605586 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.605399    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"
Jul 11 04:32:49.605586 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.605438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q" event={"ID":"22431d65-b799-41b0-8092-3553bcfeacb1","Type":"ContainerDied","Data":"3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9"}
Jul 11 04:32:49.605586 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.605489    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q" event={"ID":"22431d65-b799-41b0-8092-3553bcfeacb1","Type":"ContainerDied","Data":"41faefcb24837b66ff374b171e50fd2796204cf4974b6ed06faa15b3f23ca696"}
Jul 11 04:32:49.605586 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.605520    2558 scope.go:117] "RemoveContainer" containerID="3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9"
Jul 11 04:32:49.620233 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.620209    2558 scope.go:117] "RemoveContainer" containerID="3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9"
Jul 11 04:32:49.620540 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:32:49.620519    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9\": container with ID starting with 3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9 not found: ID does not exist" containerID="3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9"
Jul 11 04:32:49.620612 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.620550    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9"} err="failed to get container status \"3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9\": rpc error: code = NotFound desc = could not find container \"3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9\": container with ID starting with 3a4834aab68c3debf458ded7daf963c30309cca484e36e4335c8ab160a61a1d9 not found: ID does not exist"
Jul 11 04:32:49.628640 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.628617    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"]
Jul 11 04:32:49.631748 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.631723    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3055d9/sub-test-model-3055d9-kserve-5b8d8b44cf-hzx2q"]
Jul 11 04:32:49.814960 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:49.814881    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:32:51.538778 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:32:51.538745    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22431d65-b799-41b0-8092-3553bcfeacb1" path="/var/lib/kubelet/pods/22431d65-b799-41b0-8092-3553bcfeacb1/volumes"
Jul 11 04:33:05.696581 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:05.696542    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:33:09.463180 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:09.463146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:33:09.567796 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:09.567764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:33:17.754605 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:17.754513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:33:17.855075 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:17.855033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:33:21.767750 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:21.767717    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:33:21.776948 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:21.776922    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:33:54.878890 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:54.878851    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:33:55.811640 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:33:55.811609    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:09.120945 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.120910    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:09.121346 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.121335    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22431d65-b799-41b0-8092-3553bcfeacb1" containerName="main"
Jul 11 04:34:09.121390 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.121350    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22431d65-b799-41b0-8092-3553bcfeacb1" containerName="main"
Jul 11 04:34:09.121428 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.121422    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="22431d65-b799-41b0-8092-3553bcfeacb1" containerName="main"
Jul 11 04:34:09.124464 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.124449    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:09.127064 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.127016    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-47b7r\""
Jul 11 04:34:09.132657 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.132633    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:09.272375 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.272343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47xsz\" (UniqueName: \"kubernetes.io/projected/d4ae1904-33e0-44da-8431-523f445bc707-kube-api-access-47xsz\") pod \"test-curl-7783-140586032473552\" (UID: \"d4ae1904-33e0-44da-8431-523f445bc707\") " pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:09.373956 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.373872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47xsz\" (UniqueName: \"kubernetes.io/projected/d4ae1904-33e0-44da-8431-523f445bc707-kube-api-access-47xsz\") pod \"test-curl-7783-140586032473552\" (UID: \"d4ae1904-33e0-44da-8431-523f445bc707\") " pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:09.381765 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.381732    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47xsz\" (UniqueName: \"kubernetes.io/projected/d4ae1904-33e0-44da-8431-523f445bc707-kube-api-access-47xsz\") pod \"test-curl-7783-140586032473552\" (UID: \"d4ae1904-33e0-44da-8431-523f445bc707\") " pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:09.434973 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.434934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:09.573728 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.573701    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:09.575152 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:34:09.575128    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4ae1904_33e0_44da_8431_523f445bc707.slice/crio-52cfe97f8088bb93cedc4ea47aa46728536c97f5be7e927ab1fb1aa74aad8728 WatchSource:0}: Error finding container 52cfe97f8088bb93cedc4ea47aa46728536c97f5be7e927ab1fb1aa74aad8728: Status 404 returned error can't find the container with id 52cfe97f8088bb93cedc4ea47aa46728536c97f5be7e927ab1fb1aa74aad8728
Jul 11 04:34:09.576647 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:09.576625    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 04:34:10.041359 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:10.041269    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032473552" event={"ID":"d4ae1904-33e0-44da-8431-523f445bc707","Type":"ContainerStarted","Data":"52cfe97f8088bb93cedc4ea47aa46728536c97f5be7e927ab1fb1aa74aad8728"}
Jul 11 04:34:11.047959 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:11.047922    2558 generic.go:356] "Generic (PLEG): container finished" podID="d4ae1904-33e0-44da-8431-523f445bc707" containerID="9bd163f71e41f072a38e9f21161be006b9c1c0082994744ec41055f01d02ad69" exitCode=0
Jul 11 04:34:11.048356 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:11.048010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7783-140586032473552" event={"ID":"d4ae1904-33e0-44da-8431-523f445bc707","Type":"ContainerDied","Data":"9bd163f71e41f072a38e9f21161be006b9c1c0082994744ec41055f01d02ad69"}
Jul 11 04:34:12.197948 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:12.197923    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:12.216779 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:12.216752    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7783-140586032473552_d4ae1904-33e0-44da-8431-523f445bc707/test-curl-7783-140586032473552/0.log"
Jul 11 04:34:12.240752 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:12.240721    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:12.243005 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:12.242982    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7783-140586032473552"]
Jul 11 04:34:12.306730 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:12.306630    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47xsz\" (UniqueName: \"kubernetes.io/projected/d4ae1904-33e0-44da-8431-523f445bc707-kube-api-access-47xsz\") pod \"d4ae1904-33e0-44da-8431-523f445bc707\" (UID: \"d4ae1904-33e0-44da-8431-523f445bc707\") "
Jul 11 04:34:12.308824 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:12.308780    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ae1904-33e0-44da-8431-523f445bc707-kube-api-access-47xsz" (OuterVolumeSpecName: "kube-api-access-47xsz") pod "d4ae1904-33e0-44da-8431-523f445bc707" (UID: "d4ae1904-33e0-44da-8431-523f445bc707"). InnerVolumeSpecName "kube-api-access-47xsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:12.408132 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:12.408099    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47xsz\" (UniqueName: \"kubernetes.io/projected/d4ae1904-33e0-44da-8431-523f445bc707-kube-api-access-47xsz\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:34:13.060012 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:13.059980    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:13.060221 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:13.060031    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52cfe97f8088bb93cedc4ea47aa46728536c97f5be7e927ab1fb1aa74aad8728"
Jul 11 04:34:13.070187 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:34:13.070155    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-140586032473552\" is forbidden: User \"system:node:ip-10-0-138-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-121.ec2.internal' and this object" podUID="d4ae1904-33e0-44da-8431-523f445bc707" pod="openshift-ingress/test-curl-7783-140586032473552"
Jul 11 04:34:13.538614 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:13.538580    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ae1904-33e0-44da-8431-523f445bc707" path="/var/lib/kubelet/pods/d4ae1904-33e0-44da-8431-523f445bc707/volumes"
Jul 11 04:34:15.685915 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:15.685880    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:15.787604 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:15.787571    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:25.624818 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:25.624747    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:30.306882 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:30.306841    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:35.938138 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:35.938099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:36.039741 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:36.039704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:40.969450 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:40.969416    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:41.202211 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:41.202167    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:41.882511 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:41.882475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:41.984887 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:41.984854    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:45.782502 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:45.782401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:45.830307 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:45.830276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:51.703202 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:51.703169    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:34:56.390608 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:34:56.390562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:35:02.223759 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:02.223712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:35:02.323246 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:02.323213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:35:07.024064 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:07.024024    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"]
Jul 11 04:35:07.024564 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:07.024273    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy" containerID="cri-o://c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e" gracePeriod=30
Jul 11 04:35:07.038414 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:07.038389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:35:07.274495 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:07.274410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:35:07.685293 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:07.685260    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bbbb5b67-k9jpl_caf7e6e0-a859-4576-9edc-8fc49aca9efc/authorino/0.log"
Jul 11 04:35:11.987106 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:11.987064    2558 patch_prober.go:28] interesting pod/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 04:35:11.987499 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:11.987130    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 04:35:12.287284 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.287253    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:35:12.368019 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.367987    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-envoy\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368019 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368029    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-token\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368262 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368075    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-certs\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368262 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368092    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-podinfo\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368262 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368125    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-data\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368262 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368148    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istiod-ca-cert\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368262 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368170    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-credential-socket\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368262 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368197    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-socket\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368581 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368267    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72r6v\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-kube-api-access-72r6v\") pod \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\" (UID: \"8b78cced-28ff-4ca7-87e1-854cc9eaff93\") "
Jul 11 04:35:12.368581 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368437    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:35:12.368581 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368545    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-certs\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.368760 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368608    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:35:12.368760 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368679    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:35:12.368894 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.368775    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:35:12.369252 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.369233    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:35:12.370398 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.370375    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:35:12.370603 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.370583    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-kube-api-access-72r6v" (OuterVolumeSpecName: "kube-api-access-72r6v") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "kube-api-access-72r6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:35:12.370671 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.370657    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:35:12.370718 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.370700    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b78cced-28ff-4ca7-87e1-854cc9eaff93" (UID: "8b78cced-28ff-4ca7-87e1-854cc9eaff93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:35:12.391507 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.391468    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerID="c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e" exitCode=0
Jul 11 04:35:12.391650 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.391516    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"
Jul 11 04:35:12.391650 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.391543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" event={"ID":"8b78cced-28ff-4ca7-87e1-854cc9eaff93","Type":"ContainerDied","Data":"c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e"}
Jul 11 04:35:12.391650 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.391602    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr" event={"ID":"8b78cced-28ff-4ca7-87e1-854cc9eaff93","Type":"ContainerDied","Data":"6699dbd0f7a500521b9d1bf0820d9823fd86c936c9fbdc87f9eb7a7442fcaab9"}
Jul 11 04:35:12.391650 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.391625    2558 scope.go:117] "RemoveContainer" containerID="c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e"
Jul 11 04:35:12.402172 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.402153    2558 scope.go:117] "RemoveContainer" containerID="b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5"
Jul 11 04:35:12.411068 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.411051    2558 scope.go:117] "RemoveContainer" containerID="c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e"
Jul 11 04:35:12.411365 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:35:12.411345    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e\": container with ID starting with c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e not found: ID does not exist" containerID="c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e"
Jul 11 04:35:12.411414 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.411375    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e"} err="failed to get container status \"c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e\": rpc error: code = NotFound desc = could not find container \"c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e\": container with ID starting with c2641c198bb25395c53cdc6c719524c2b46b98437e08de04e1de8b0aa60bd10e not found: ID does not exist"
Jul 11 04:35:12.411414 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.411395    2558 scope.go:117] "RemoveContainer" containerID="b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5"
Jul 11 04:35:12.411651 ip-10-0-138-121 kubenswrapper[2558]: E0711 04:35:12.411635    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5\": container with ID starting with b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5 not found: ID does not exist" containerID="b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5"
Jul 11 04:35:12.411710 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.411655    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5"} err="failed to get container status \"b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5\": rpc error: code = NotFound desc = could not find container \"b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5\": container with ID starting with b790246ed28e37b5d267af8c09746f6953b0ae7b3e14078ff88000499449e6d5 not found: ID does not exist"
Jul 11 04:35:12.412836 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.412816    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"]
Jul 11 04:35:12.415846 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.415824    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-eefca5-openshift-default-77664687b7-mv2fr"]
Jul 11 04:35:12.469258 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469223    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72r6v\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-kube-api-access-72r6v\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.469258 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469255    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-envoy\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.469258 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469266    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-token\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.469492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469273    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-podinfo\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.469492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469282    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istio-data\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.469492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469290    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b78cced-28ff-4ca7-87e1-854cc9eaff93-istiod-ca-cert\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.469492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469297    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-credential-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.469492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.469307    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b78cced-28ff-4ca7-87e1-854cc9eaff93-workload-socket\") on node \"ip-10-0-138-121.ec2.internal\" DevicePath \"\""
Jul 11 04:35:12.700978 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.700943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5476cb467b-d6zg5_860c3c59-8ed3-4695-85fe-0ea70eae1abe/manager/0.log"
Jul 11 04:35:12.816893 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.816863    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k2ptl_c720e155-b4dc-4026-9435-60e6edc1b0b3/server/0.log"
Jul 11 04:35:12.931240 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:12.931209    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7496v_330e4cd1-862b-4997-8d27-f71b445e21b3/manager/0.log"
Jul 11 04:35:13.054654 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:13.054555    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-8brch_5731fc91-ecc1-4fb3-82db-262f0b3a715b/copy-manifests/0.log"
Jul 11 04:35:13.060818 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:13.060778    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-8brch_5731fc91-ecc1-4fb3-82db-262f0b3a715b/manager/0.log"
Jul 11 04:35:13.540108 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:13.540074    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" path="/var/lib/kubelet/pods/8b78cced-28ff-4ca7-87e1-854cc9eaff93/volumes"
Jul 11 04:35:16.712354 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:16.712313    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bbbb5b67-k9jpl_caf7e6e0-a859-4576-9edc-8fc49aca9efc/authorino/0.log"
Jul 11 04:35:16.842839 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:16.842795    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2g5nc_16d1e9ec-11c0-4fcd-859f-dc141be5fea9/manager/0.log"
Jul 11 04:35:16.953333 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:16.953300    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-h7frx_8d97e7fb-475d-485c-aee3-2b9eacf06a5d/manager/0.log"
Jul 11 04:35:17.183014 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:17.182980    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hnbr8_3ed29283-9a27-4756-9d8c-f93a481d6231/registry-server/0.log"
Jul 11 04:35:17.306544 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:17.306513    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tkrsm_f3fa1114-71ca-4e78-83e1-704aa96bbabb/manager/0.log"
Jul 11 04:35:17.535829 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:17.535729    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nx8dt_4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb/manager/0.log"
Jul 11 04:35:17.880168 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:17.880136    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vchkw_207e9004-3250-4b66-91d6-01169131555e/istio-proxy/0.log"
Jul 11 04:35:18.218006 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:18.217921    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-hz8th_4de92070-e926-4bc3-b302-84ca89309913/kube-auth-proxy/0.log"
Jul 11 04:35:18.339213 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:18.339184    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7xft6_a5e202f9-7f6a-427c-9fad-dbb1f1daf717/istio-proxy/1.log"
Jul 11 04:35:18.460147 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:18.460119    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jxfgx_9e0a315a-f297-4355-8166-5053f45bd000/payload-pre-processing/0.log"
Jul 11 04:35:18.581963 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:18.581882    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pvm9r_26cf4400-30cd-4492-bc47-b983308a9941/payload-processing/0.log"
Jul 11 04:35:18.695718 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:18.695684    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d5b8478-qbnr4_bd03e2e5-4763-411f-8978-1c515b287ca0/router/0.log"
Jul 11 04:35:19.042187 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:19.042137    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2ldr7_bfd82aee-8597-43b9-8137-62ffeb4be0bf/main/0.log"
Jul 11 04:35:19.273665 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:19.273608    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-llp2w_0157473a-1dce-4430-b288-8f6e4e4b5420/main/0.log"
Jul 11 04:35:23.952860 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:23.952773    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:35:24.011330 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:24.011289    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log" limit=1024
Jul 11 04:35:26.641486 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:26.641448    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bwfm4_41dfa086-33fd-4a06-be28-9f8954c06cce/global-pull-secret-syncer/0.log"
Jul 11 04:35:26.762177 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:26.762120    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hlxkm_f826c89f-a3e2-4bae-a739-3210cc93e955/konnectivity-agent/0.log"
Jul 11 04:35:26.883448 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:26.883413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-121.ec2.internal_ec96949558917645dae8243207f7883f/haproxy/0.log"
Jul 11 04:35:31.668000 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:31.667968    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bbbb5b67-k9jpl_caf7e6e0-a859-4576-9edc-8fc49aca9efc/authorino/0.log"
Jul 11 04:35:31.718573 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:31.718543    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2g5nc_16d1e9ec-11c0-4fcd-859f-dc141be5fea9/manager/0.log"
Jul 11 04:35:31.739639 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:31.739609    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-h7frx_8d97e7fb-475d-485c-aee3-2b9eacf06a5d/manager/0.log"
Jul 11 04:35:31.801941 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:31.801900    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hnbr8_3ed29283-9a27-4756-9d8c-f93a481d6231/registry-server/0.log"
Jul 11 04:35:31.916027 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:31.915995    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tkrsm_f3fa1114-71ca-4e78-83e1-704aa96bbabb/manager/0.log"
Jul 11 04:35:32.000841 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:32.000736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nx8dt_4a3b6a09-b8b3-43f3-9cac-1db38a09c6fb/manager/0.log"
Jul 11 04:35:33.962843 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:33.962813    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-hkbf5_8229f1fc-b1fb-4cca-9a7c-a3c5bbee9351/cluster-monitoring-operator/0.log"
Jul 11 04:35:34.314734 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:34.314688    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlm7d_cde59669-ea2e-40c5-a093-45695df35d0b/node-exporter/0.log"
Jul 11 04:35:34.334117 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:34.334080    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlm7d_cde59669-ea2e-40c5-a093-45695df35d0b/kube-rbac-proxy/0.log"
Jul 11 04:35:34.353617 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:34.353591    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wlm7d_cde59669-ea2e-40c5-a093-45695df35d0b/init-textfile/0.log"
Jul 11 04:35:34.674987 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:34.674955    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-fwdbf_01c3ca1c-26fa-4718-8ded-3170653a3c9d/prometheus-operator-admission-webhook/0.log"
Jul 11 04:35:36.080512 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.080476    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-h988v_10de6142-232a-4633-ac66-a3bd2a4fb382/networking-console-plugin/0.log"
Jul 11 04:35:36.647910 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.647863    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"]
Jul 11 04:35:36.648391 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648371    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ae1904-33e0-44da-8431-523f445bc707" containerName="test-curl-7783-140586032473552"
Jul 11 04:35:36.648391 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648391    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ae1904-33e0-44da-8431-523f445bc707" containerName="test-curl-7783-140586032473552"
Jul 11 04:35:36.648524 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648415    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy"
Jul 11 04:35:36.648524 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648421    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy"
Jul 11 04:35:36.648524 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648427    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy"
Jul 11 04:35:36.648524 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648432    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy"
Jul 11 04:35:36.648524 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648499    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy"
Jul 11 04:35:36.648524 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648509    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b78cced-28ff-4ca7-87e1-854cc9eaff93" containerName="istio-proxy"
Jul 11 04:35:36.648524 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.648514    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ae1904-33e0-44da-8431-523f445bc707" containerName="test-curl-7783-140586032473552"
Jul 11 04:35:36.651779 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.651758    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.654451 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.654421    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpcdf\"/\"openshift-service-ca.crt\""
Jul 11 04:35:36.654451 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.654441    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpcdf\"/\"kube-root-ca.crt\""
Jul 11 04:35:36.655575 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.655560    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qpcdf\"/\"default-dockercfg-hxr4v\""
Jul 11 04:35:36.659922 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.659901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"]
Jul 11 04:35:36.685492 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.685460    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/1.log"
Jul 11 04:35:36.691161 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.691138    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qxg2b_63371df1-7c7e-4dad-ae24-fb072ee4add9/console-operator/2.log"
Jul 11 04:35:36.795758 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.795724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-lib-modules\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.796039 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.795786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqt5\" (UniqueName: \"kubernetes.io/projected/6b225177-7157-4ea0-b145-8f77e8d3c021-kube-api-access-gfqt5\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.796039 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.795843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-proc\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.796039 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.795877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-sys\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.796039 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.795898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-podres\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.896723 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.896675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqt5\" (UniqueName: \"kubernetes.io/projected/6b225177-7157-4ea0-b145-8f77e8d3c021-kube-api-access-gfqt5\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.896723 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.896728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-proc\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.896964 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.896765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-sys\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.896964 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.896783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-podres\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.896964 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.896867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-lib-modules\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.896964 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.896892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-sys\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.896964 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.896892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-proc\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.897140 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.897004    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-lib-modules\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.897140 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.897011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6b225177-7157-4ea0-b145-8f77e8d3c021-podres\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.904019 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.903962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqt5\" (UniqueName: \"kubernetes.io/projected/6b225177-7157-4ea0-b145-8f77e8d3c021-kube-api-access-gfqt5\") pod \"perf-node-gather-daemonset-sz86n\" (UID: \"6b225177-7157-4ea0-b145-8f77e8d3c021\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:36.962369 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:36.962335    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:37.099962 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:37.099936    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"]
Jul 11 04:35:37.101502 ip-10-0-138-121 kubenswrapper[2558]: W0711 04:35:37.101474    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6b225177_7157_4ea0_b145_8f77e8d3c021.slice/crio-2c4d4bb77db94eca9150fc268983a921813a99ce4f5e38fcbfd57984f1b19122 WatchSource:0}: Error finding container 2c4d4bb77db94eca9150fc268983a921813a99ce4f5e38fcbfd57984f1b19122: Status 404 returned error can't find the container with id 2c4d4bb77db94eca9150fc268983a921813a99ce4f5e38fcbfd57984f1b19122
Jul 11 04:35:37.298365 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:37.298338    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-4jmmb_3778e0e3-05c3-466c-8369-ebbda25bf65a/download-server/0.log"
Jul 11 04:35:37.526363 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:37.526266    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n" event={"ID":"6b225177-7157-4ea0-b145-8f77e8d3c021","Type":"ContainerStarted","Data":"ec4e2d2a24a8e5f1b3e52f74f53d0724c7d951a944d8519cbe4789db3d4a00cb"}
Jul 11 04:35:37.526363 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:37.526325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n" event={"ID":"6b225177-7157-4ea0-b145-8f77e8d3c021","Type":"ContainerStarted","Data":"2c4d4bb77db94eca9150fc268983a921813a99ce4f5e38fcbfd57984f1b19122"}
Jul 11 04:35:37.526363 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:37.526348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:37.541194 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:37.541146    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n" podStartSLOduration=1.541131299 podStartE2EDuration="1.541131299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 04:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:35:37.5406387 +0000 UTC m=+2836.624241036" watchObservedRunningTime="2026-07-11 04:35:37.541131299 +0000 UTC m=+2836.624733612"
Jul 11 04:35:37.946637 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:37.946607    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-stg8r_79f74409-e701-4519-92b7-dd97ee18425c/volume-data-source-validator/0.log"
Jul 11 04:35:38.886167 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:38.886140    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bxmq_66a697bc-017b-486b-ad67-a6706843bb29/dns/0.log"
Jul 11 04:35:38.904957 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:38.904927    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bxmq_66a697bc-017b-486b-ad67-a6706843bb29/kube-rbac-proxy/0.log"
Jul 11 04:35:39.033898 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:39.033863    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ns77x_45ab04ec-23fa-472b-8d12-4922b35c0107/dns-node-resolver/0.log"
Jul 11 04:35:39.572557 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:39.572521    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-66bch_c6b9e593-44c1-433a-ad4f-046bf0d4e69a/node-ca/0.log"
Jul 11 04:35:40.515240 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:40.515204    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vchkw_207e9004-3250-4b66-91d6-01169131555e/istio-proxy/0.log"
Jul 11 04:35:40.669837 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:40.669796    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-hz8th_4de92070-e926-4bc3-b302-84ca89309913/kube-auth-proxy/0.log"
Jul 11 04:35:40.694236 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:40.694209    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7xft6_a5e202f9-7f6a-427c-9fad-dbb1f1daf717/istio-proxy/0.log"
Jul 11 04:35:40.722441 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:40.722406    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7xft6_a5e202f9-7f6a-427c-9fad-dbb1f1daf717/istio-proxy/1.log"
Jul 11 04:35:40.749783 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:40.749754    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jxfgx_9e0a315a-f297-4355-8166-5053f45bd000/payload-pre-processing/0.log"
Jul 11 04:35:40.778732 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:40.778655    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pvm9r_26cf4400-30cd-4492-bc47-b983308a9941/payload-processing/0.log"
Jul 11 04:35:40.797939 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:40.797915    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d5b8478-qbnr4_bd03e2e5-4763-411f-8978-1c515b287ca0/router/0.log"
Jul 11 04:35:41.500032 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:41.499999    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2mc2_f1eaf4d0-9a9f-40a2-bb69-2721825195fe/serve-healthcheck-canary/0.log"
Jul 11 04:35:41.972177 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:41.972151    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xwrsz_158ad481-3766-49ff-a5c1-c447e652b27c/insights-operator/0.log"
Jul 11 04:35:41.972913 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:41.972893    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xwrsz_158ad481-3766-49ff-a5c1-c447e652b27c/insights-operator/1.log"
Jul 11 04:35:41.993789 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:41.993761    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xkrk_7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4/kube-rbac-proxy/0.log"
Jul 11 04:35:42.014549 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:42.014521    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xkrk_7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4/exporter/0.log"
Jul 11 04:35:42.034306 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:42.034280    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xkrk_7b8d624b-b5cf-46ad-95e0-dd0deaa45aa4/extractor/0.log"
Jul 11 04:35:43.542335 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:43.542305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-sz86n"
Jul 11 04:35:44.462111 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:44.462068    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5476cb467b-d6zg5_860c3c59-8ed3-4695-85fe-0ea70eae1abe/manager/0.log"
Jul 11 04:35:44.482491 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:44.482463    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-k2ptl_c720e155-b4dc-4026-9435-60e6edc1b0b3/server/0.log"
Jul 11 04:35:44.544168 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:44.544135    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7496v_330e4cd1-862b-4997-8d27-f71b445e21b3/manager/0.log"
Jul 11 04:35:44.568268 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:44.568237    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-8brch_5731fc91-ecc1-4fb3-82db-262f0b3a715b/manager/0.log"
Jul 11 04:35:44.588973 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:44.588943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-8brch_5731fc91-ecc1-4fb3-82db-262f0b3a715b/copy-manifests/0.log"
Jul 11 04:35:47.241862 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:47.241831    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vchkw_207e9004-3250-4b66-91d6-01169131555e/istio-proxy/0.log"
Jul 11 04:35:47.377607 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:47.377579    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-hz8th_4de92070-e926-4bc3-b302-84ca89309913/kube-auth-proxy/0.log"
Jul 11 04:35:47.394453 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:47.394426    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7xft6_a5e202f9-7f6a-427c-9fad-dbb1f1daf717/istio-proxy/0.log"
Jul 11 04:35:47.425567 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:47.425534    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7xft6_a5e202f9-7f6a-427c-9fad-dbb1f1daf717/istio-proxy/1.log"
Jul 11 04:35:47.446030 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:47.446001    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jxfgx_9e0a315a-f297-4355-8166-5053f45bd000/payload-pre-processing/0.log"
Jul 11 04:35:47.464711 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:47.464686    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pvm9r_26cf4400-30cd-4492-bc47-b983308a9941/payload-processing/0.log"
Jul 11 04:35:47.479631 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:47.479609    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d5b8478-qbnr4_bd03e2e5-4763-411f-8978-1c515b287ca0/router/0.log"
Jul 11 04:35:48.745854 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:48.745750    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vchkw_207e9004-3250-4b66-91d6-01169131555e/istio-proxy/0.log"
Jul 11 04:35:48.885632 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:48.885600    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b7c6c587f-hz8th_4de92070-e926-4bc3-b302-84ca89309913/kube-auth-proxy/0.log"
Jul 11 04:35:48.902548 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:48.902524    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7xft6_a5e202f9-7f6a-427c-9fad-dbb1f1daf717/istio-proxy/0.log"
Jul 11 04:35:48.933145 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:48.933114    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7xft6_a5e202f9-7f6a-427c-9fad-dbb1f1daf717/istio-proxy/1.log"
Jul 11 04:35:48.952442 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:48.952415    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jxfgx_9e0a315a-f297-4355-8166-5053f45bd000/payload-pre-processing/0.log"
Jul 11 04:35:48.974591 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:48.974563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pvm9r_26cf4400-30cd-4492-bc47-b983308a9941/payload-processing/0.log"
Jul 11 04:35:48.994514 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:48.994490    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84d5b8478-qbnr4_bd03e2e5-4763-411f-8978-1c515b287ca0/router/0.log"
Jul 11 04:35:51.114670 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:51.114644    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4h648_84128f04-6c9b-4f78-baf5-73b8eb791ff2/migrator/0.log"
Jul 11 04:35:51.132988 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:51.132960    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4h648_84128f04-6c9b-4f78-baf5-73b8eb791ff2/graceful-termination/0.log"
Jul 11 04:35:51.456644 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:51.456562    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wxggb_dc91ca83-83d5-4303-9683-06cf1e241801/kube-storage-version-migrator-operator/1.log"
Jul 11 04:35:51.457384 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:51.457363    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wxggb_dc91ca83-83d5-4303-9683-06cf1e241801/kube-storage-version-migrator-operator/0.log"
Jul 11 04:35:52.363042 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.363010    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4w2w5_2a767922-f3e8-4f33-b2ff-f3e317d27798/kube-multus/0.log"
Jul 11 04:35:52.682476 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.682389    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz5xh_7d465f22-313f-42b6-b381-08efae2a0ecb/kube-multus-additional-cni-plugins/0.log"
Jul 11 04:35:52.700608 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.700581    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz5xh_7d465f22-313f-42b6-b381-08efae2a0ecb/egress-router-binary-copy/0.log"
Jul 11 04:35:52.718638 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.718612    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz5xh_7d465f22-313f-42b6-b381-08efae2a0ecb/cni-plugins/0.log"
Jul 11 04:35:52.738506 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.738475    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz5xh_7d465f22-313f-42b6-b381-08efae2a0ecb/bond-cni-plugin/0.log"
Jul 11 04:35:52.757646 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.757618    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz5xh_7d465f22-313f-42b6-b381-08efae2a0ecb/routeoverride-cni/0.log"
Jul 11 04:35:52.775674 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.775644    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz5xh_7d465f22-313f-42b6-b381-08efae2a0ecb/whereabouts-cni-bincopy/0.log"
Jul 11 04:35:52.793471 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.793448    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zz5xh_7d465f22-313f-42b6-b381-08efae2a0ecb/whereabouts-cni/0.log"
Jul 11 04:35:52.889242 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.889208    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2h7hm_268cd590-e93d-4e86-b011-3a28a0159167/network-metrics-daemon/0.log"
Jul 11 04:35:52.903215 ip-10-0-138-121 kubenswrapper[2558]: I0711 04:35:52.903184    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2h7hm_268cd590-e93d-4e86-b011-3a28a0159167/kube-rbac-proxy/0.log"