Jul 13 15:21:55.227126 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 15:21:55.227138 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 15:21:55.227145 ip-10-0-139-109 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 15:21:55.227429 ip-10-0-139-109 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 15:22:05.364725 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 15:22:05.364746 ip-10-0-139-109 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b03b13f86bbe4731aec8d9c29b66e3d4 --
Jul 13 15:24:06.327573 ip-10-0-139-109 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.720639    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725354    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725366    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725370    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725374    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725377    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725380    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725383    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:06.873088 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725386    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:06.809479 ip-10-0-139-109 systemd[1]: Started Kubernetes Kubelet.
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725390    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725394    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725396    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725399    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725402    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725405    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725408    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725411    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725419    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725422    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725425    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725428    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725431    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725434    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725436    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725439    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725442    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725445    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725448    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:06.874779 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725453    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725456    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725459    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725462    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725464    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725467    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725470    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725473    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725476    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725479    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725482    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725485    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725488    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725491    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725494    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725497    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725499    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725502    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725505    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725508    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:06.877908 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725511    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725513    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725516    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725519    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725522    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725525    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725528    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725530    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725533    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725537    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725540    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725545    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725549    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725553    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725555    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725558    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725561    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725564    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725566    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:06.878603 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725571    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725574    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725578    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725581    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725584    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725587    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725590    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725593    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725596    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725599    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725601    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725604    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725607    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725610    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725615    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725618    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725620    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725623    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725626    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725629    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:06.879209 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725635    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725638    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725642    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725645    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725648    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725652    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725656    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725659    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725662    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725665    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725669    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725672    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.725675    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727220    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727229    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727233    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727236    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727239    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727243    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:07.072492 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727246    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727249    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727252    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727255    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727257    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727260    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727264    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727267    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727270    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727272    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727275    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727278    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727281    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727284    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727287    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727291    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727295    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727298    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727301    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727304    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:07.073930 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727307    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727310    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727312    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727315    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727318    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727320    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727323    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727326    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727328    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727331    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727334    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727350    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727354    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727357    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727360    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727363    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727365    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727368    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727374    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727377    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:07.075261 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727380    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727382    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727385    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727389    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727392    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727395    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727397    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727400    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727403    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727406    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727408    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727411    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727414    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727416    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727419    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727422    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727425    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727428    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727431    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727433    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:07.076670 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727439    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727442    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727446    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727450    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727452    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727456    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727459    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727461    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727464    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727467    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727471    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727474    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727476    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727479    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727482    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727485    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727487    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727498    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727501    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727503    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:07.077875 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727506    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727509    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727511    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727514    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727517    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727523    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727526    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727529    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727532    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727535    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727538    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727541    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727544    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727953    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727959    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727962    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727966    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727969    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727972    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727976    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:07.079974 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727979    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727982    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727988    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727992    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727995    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.727998    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728001    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728005    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728008    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728011    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728014    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728017    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728021    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728024    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728027    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728030    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728033    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728037    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728040    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:07.080907 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728043    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728046    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728048    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728051    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728055    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728060    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728063    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728066    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728069    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728072    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728075    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728078    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728081    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728083    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728086    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728091    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728093    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728096    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728099    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728102    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:07.081792 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728104    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728107    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728111    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728114    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728117    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728119    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728122    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728125    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728129    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728133    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728137    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728140    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728143    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728146    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728149    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728151    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728154    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728157    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728159    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:07.082613 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728162    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728165    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728168    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728170    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728173    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728176    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728179    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728181    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728185    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728188    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728191    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728194    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728196    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728199    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728202    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728204    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728207    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728209    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728212    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:07.083360 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728215    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728217    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728220    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728223    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728227    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728230    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728233    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728236    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728238    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728241    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728243    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728246    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728249    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728252    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.728254    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728328    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728336    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728361    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728368    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728375    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728379    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 15:24:07.084133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728385    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728390    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728393    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728396    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728400    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728403    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728407    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728410    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728413    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728416    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728419    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728422    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728427    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728431    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728434    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728438    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728442    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728446    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728450    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728453    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728457    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728460    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728464    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728467    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 15:24:07.084946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728470    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728473    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728478    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728481    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728484    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728487    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728490    2556 flags.go:64] FLAG: --enable-server="true"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728494    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728500    2556 flags.go:64] FLAG: --event-burst="100"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728504    2556 flags.go:64] FLAG: --event-qps="50"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728507    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728510    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728513    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728517    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728520    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728523    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728526    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728529    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728532    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728535    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728539    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728542    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728545    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728550    2556 flags.go:64] FLAG: --feature-gates=""
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728554    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 15:24:07.085595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728557    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728560    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728564    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728567    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728570    2556 flags.go:64] FLAG: --help="false"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728573    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728577    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728580    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728583    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728586    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728590    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728593    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728596    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728599    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728602    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728607    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728611    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728614    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728617    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728620    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728623    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728626    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728629    2556 flags.go:64] FLAG: --lock-file=""
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728632    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 15:24:07.086271 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728635    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728639    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728644    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728647    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728650    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728653    2556 flags.go:64] FLAG: --logging-format="text"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728657    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728661    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728664    2556 flags.go:64] FLAG: --manifest-url=""
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728667    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728671    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728675    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728679    2556 flags.go:64] FLAG: --max-pods="110"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728682    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728685    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728688    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728692    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728695    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728698    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728701    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728709    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728712    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728715    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 15:24:07.086949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728720    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728724    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728730    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728733    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728736    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728739    2556 flags.go:64] FLAG: --port="10250"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728742    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728746    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08a65279632f94bca"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728749    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728752    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728755    2556 flags.go:64] FLAG: --register-node="true"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728758    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728762    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728765    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728768    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728772    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728776    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728779    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728782    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728785    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728788    2556 flags.go:64] FLAG: --runonce="false"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728791    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728794    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728797    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728800    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 15:24:07.087580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728803    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728806    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728809    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728812    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728815    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728818    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728821    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728824    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728829    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728833    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728836    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728842    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728845    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728848    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728852    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728855    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728858    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728861    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728864    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728867    2556 flags.go:64] FLAG: --v="2"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728871    2556 flags.go:64] FLAG: --version="false"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728875    2556 flags.go:64] FLAG: --vmodule=""
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728880    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.728884    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729004    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:07.088267 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729008    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729011    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729015    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729019    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729022    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729024    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729027    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729030    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729034    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729038    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729041    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729045    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729047    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729050    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729053    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729059    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729063    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729066    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729070    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:07.089019 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729073    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729076    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729078    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729081    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729084    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729087    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729090    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729092    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729096    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729098    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729103    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729106    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729108    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729111    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729114    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729117    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729120    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729123    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729125    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729128    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:07.089605 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729131    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729133    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729136    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729139    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729141    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729144    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729147    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729149    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729153    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729156    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729159    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729169    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729172    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729175    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729178    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729180    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729183    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729186    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729188    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729191    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:07.090145 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729194    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729197    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729201    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729204    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729208    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729212    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729215    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729218    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729221    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729223    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729226    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729229    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729232    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729234    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729237    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729240    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729243    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729245    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729248    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:07.090685 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729250    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729254    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729257    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729260    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729262    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729266    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729268    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729271    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729274    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729277    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729280    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729283    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729286    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729289    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729291    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729299    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729301    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729304    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729307    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:07.091190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.729310    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.729316    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.737631    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.737651    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.737670    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.737676    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737745    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737750    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737754    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737758    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737761    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737764    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737767    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737771    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737774    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:07.091734 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737777    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737781    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737784    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737787    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737791    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737795    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737799    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737802    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737805    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737808    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737810    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737813    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737816    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737819    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737822    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737825    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737828    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737831    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737833    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737836    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:07.092139 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737849    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737852    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737855    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737858    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737860    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737863    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737866    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737869    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737872    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737874    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737877    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737881    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737885    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737888    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737892    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737895    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737898    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737902    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737905    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:07.092684 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737908    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737910    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737913    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737916    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737919    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737922    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737924    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737927    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737929    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737933    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737936    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737938    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737941    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737946    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737955    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737958    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737961    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737964    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737966    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:07.093186 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737969    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737972    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737975    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737977    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737980    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737983    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737986    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737988    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737991    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737994    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.737997    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738002    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738005    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738008    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738011    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738014    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738017    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738020    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738023    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:07.093712 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738026    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738028    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738031    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738034    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738037    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738039    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738042    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738048    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738051    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738060    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738063    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738066    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738068    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.738074    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738237    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:07.094205 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738242    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738245    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738248    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738252    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738255    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738258    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738261    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738263    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738266    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738269    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738272    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738275    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738277    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738280    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738283    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738286    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738288    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738291    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738294    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738297    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:07.094820 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738299    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738302    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738305    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738308    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738313    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738317    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738320    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738331    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738334    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738356    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738360    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738365    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738369    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738372    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738375    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738378    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738381    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738384    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738386    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738389    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:07.095361 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738392    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738395    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738398    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738401    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738404    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738407    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738410    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738414    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738417    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738420    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738423    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738425    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738428    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738430    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738433    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738436    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738440    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738444    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738447    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738450    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:07.095900 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738459    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738462    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738465    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738469    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738472    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738476    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738479    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738482    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738485    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738488    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738491    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738494    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738497    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738500    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738502    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738505    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738508    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738510    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738513    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:07.096443 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738516    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738518    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738521    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738524    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738526    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738529    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738532    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738535    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738537    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738542    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738546    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738549    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738551    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738554    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738563    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738566    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738569    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738572    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:07.096931 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:06.738575    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.738580    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.738710    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.743406    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.744740    2556 server.go:1019] "Starting client certificate rotation"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.744879    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.744928    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.750529    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.751698    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.767686    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.770102    2556 log.go:25] "Validated CRI v1 image API"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.771019    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 15:24:07.097423 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.778857    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 15:24:07.097745 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.779062    2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 90465cc0-f1ff-4cca-83ad-e3077da99574:/dev/nvme0n1p3 e7975d14-e522-4e4f-bc44-78cc2801ed56:/dev/nvme0n1p4]
Jul 13 15:24:07.097745 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.779078    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.785772    2556 manager.go:216] Machine: {Timestamp:2026-07-13 15:24:06.784428972 +0000 UTC m=+0.345119453 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099718 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec274a0cef159ec836e15d3b340c3972 SystemUUID:ec274a0c-ef15-9ec8-36e1-5d3b340c3972 BootID:b03b13f8-6bbe-4731-aec8-d9c29b66e3d4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:07:63:b5:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:07:63:b5:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:3a:16:6c:25:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.785902    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.786018    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.789108    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.789140    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.789783    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.789794    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.789802    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.790489    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.791730    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.795483    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.795655    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.795685    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.795707    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.795726    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.795767    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.795779    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 15:24:07.097811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.796218    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.796239    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.798633    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.800387    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.800418    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801103    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801119    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801125    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801131    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801141    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801147    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801156    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801161    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801169    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801174    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801184    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801189    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801840    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.801848    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.807547    2556 server.go:1268] "Started kubelet"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.808409    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.808896    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.809003    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.815044    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpcg2"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.815121    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.815208    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.815233    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.815252    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.816085    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.816757    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.817786    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-109.ec2.internal.18c1e2c131c9bc25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-109.ec2.internal,UID:ip-10-0-139-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-109.ec2.internal,},FirstTimestamp:2026-07-13 15:24:06.807297061 +0000 UTC m=+0.367987547,LastTimestamp:2026-07-13 15:24:06.807297061 +0000 UTC m=+0.367987547,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-109.ec2.internal,}"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.825293    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpcg2"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.828708    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.828723    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.828774    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829408    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829414    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829444    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829507    2556 factory.go:55] Registering systemd factory
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829521    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 13 15:24:07.098468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829661    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829672    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829857    2556 factory.go:153] Registering CRI-O factory
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829869    2556 factory.go:223] Registration of the crio container factory successfully
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829912    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829930    2556 factory.go:103] Registering Raw factory
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.829941    2556 manager.go:1196] Started watching for new ooms in manager
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.830325    2556 manager.go:349] Starting recovery of all containers
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.830767    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.830838    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.839795    2556 manager.go:354] Recovery completed
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.843623    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.849049    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.849083    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.849099    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.849696    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.849706    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.849723    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.849741    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.850872    2556 policy_none.go:49] "None policy: Start"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.850885    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.850896    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.851799    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.851826    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.851844    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.851953    2556 policy_none.go:47] "Start"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.911881    2556 manager.go:337] "Starting Device Plugin manager"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.911911    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.911920    2556 server.go:87] "Starting device plugin registration server"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.912146    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.912157    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.912299    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.912398    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:06.912409    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.912851    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:06.912898    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.015474    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.016569    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.016601    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.016616    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.016645    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.027698    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.027733    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-109.ec2.internal\": node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.047783    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.070962    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.072325    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 15:24:07.099535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.072370    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 15:24:07.100773 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.072394    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 15:24:07.100773 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.072434    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 15:24:07.100773 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.084981    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:07.148880 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.148819    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.173838 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.173813    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"]
Jul 13 15:24:07.173888 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.173880    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:07.175731 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.175716    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:07.175795 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.175747    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:07.175795 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.175758    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:07.177084 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.177070    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:07.177232 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.177203    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.177296 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.177254    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:07.177931 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.177913    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:07.178027 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.177947    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:07.178027 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.177962    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:07.178027 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.177915    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:07.178027 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.178028    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:07.178224 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.178042    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:07.179496 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.179478    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.179590 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.179509    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:07.180220 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.180200    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:07.180220 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.180223    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:07.180378 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.180236    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:07.196031 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.195858    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-109.ec2.internal\" not found" node="ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.199359 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.199334    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-109.ec2.internal\" not found" node="ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.231874 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.231853    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8192ca88aa5f8bffc58c5b17fd60492-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"e8192ca88aa5f8bffc58c5b17fd60492\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.231949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.231883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8192ca88aa5f8bffc58c5b17fd60492-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"e8192ca88aa5f8bffc58c5b17fd60492\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.231949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.231903    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f6bd2ba4ae233da88135071168265b2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"6f6bd2ba4ae233da88135071168265b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.249244 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.249227    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.333071 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.333040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8192ca88aa5f8bffc58c5b17fd60492-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"e8192ca88aa5f8bffc58c5b17fd60492\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.333071 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.333067    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8192ca88aa5f8bffc58c5b17fd60492-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"e8192ca88aa5f8bffc58c5b17fd60492\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.333227 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.333110    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f6bd2ba4ae233da88135071168265b2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"6f6bd2ba4ae233da88135071168265b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.333227 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.333129    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8192ca88aa5f8bffc58c5b17fd60492-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"e8192ca88aa5f8bffc58c5b17fd60492\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.333227 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.333165    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8192ca88aa5f8bffc58c5b17fd60492-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"e8192ca88aa5f8bffc58c5b17fd60492\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.333227 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.333195    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f6bd2ba4ae233da88135071168265b2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"6f6bd2ba4ae233da88135071168265b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.350416 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.350389    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.450989 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.450906    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.503155 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.503124    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.503238 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.503134    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:07.551795 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.551766    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.652699 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.652667    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.743758 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.743699    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 15:24:07.743868 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.743849    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 15:24:07.753742 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.753722    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.831055 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.831022    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 15:19:07 +0000 UTC" deadline="2028-01-09 22:01:33.150552474 +0000 UTC"
Jul 13 15:24:07.831055 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.831051    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13086h37m25.319505091s"
Jul 13 15:24:07.854648 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.854619    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:07.927279 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:07.927249    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:07.955643 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:07.955607    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:08.032151 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.032093    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:08.056704 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.056675    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:08.149227 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:08.149197    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6bd2ba4ae233da88135071168265b2.slice/crio-07593e6961e9fef045a1c222851003d98a57a719219bc1a6b8b484ec41a3e8ff WatchSource:0}: Error finding container 07593e6961e9fef045a1c222851003d98a57a719219bc1a6b8b484ec41a3e8ff: Status 404 returned error can't find the container with id 07593e6961e9fef045a1c222851003d98a57a719219bc1a6b8b484ec41a3e8ff
Jul 13 15:24:08.149625 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:08.149611    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8192ca88aa5f8bffc58c5b17fd60492.slice/crio-3e732e8844fdd399e31d7c88b1cbb93028535968f3df3d5dc6f97783bf65d62c WatchSource:0}: Error finding container 3e732e8844fdd399e31d7c88b1cbb93028535968f3df3d5dc6f97783bf65d62c: Status 404 returned error can't find the container with id 3e732e8844fdd399e31d7c88b1cbb93028535968f3df3d5dc6f97783bf65d62c
Jul 13 15:24:08.154826 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.154810    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:24:08.157595 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.157575    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found"
Jul 13 15:24:08.197670 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.197643    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:08.229151 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.229131    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:08.242683 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.242664    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 15:24:08.243528 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.243516    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"
Jul 13 15:24:08.253940 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.253919    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 15:24:08.798772 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.798740    2556 apiserver.go:52] "Watching apiserver"
Jul 13 15:24:08.805694 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.805428    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 15:24:08.806194 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.805993    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2xltf","openshift-multus/multus-678q9","openshift-multus/multus-additional-cni-plugins-g9vqf","openshift-multus/network-metrics-daemon-vfdrs","openshift-network-diagnostics/network-check-target-jr97l","kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wbn4v","openshift-dns/node-resolver-26hm5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal","openshift-network-operator/iptables-alerter-rrfqw","openshift-ovn-kubernetes/ovnkube-node-v745k","kube-system/global-pull-secret-syncer-45g28","kube-system/konnectivity-agent-fnpsb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"]
Jul 13 15:24:08.808511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.807869    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.809416 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.809121    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:08.810757 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.810726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.811914 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.811877    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:08.812014 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.811945    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:08.812193 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.812163    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.812299 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.812237    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.812299 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.812254    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mn9k5\""
Jul 13 15:24:08.814092 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.814068    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:08.814192 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.814166    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:08.814878 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.814693    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.815626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.815606    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.815890 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.815871    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 15:24:08.816435 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.816374    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.818638 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.817726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.818638 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818545    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 15:24:08.818638 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818560    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9mdmd\""
Jul 13 15:24:08.818802 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818764    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 15:24:08.818802 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818793    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d69xj\""
Jul 13 15:24:08.818905 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818822    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 15:24:08.818905 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818878    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 15:24:08.819003 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818957    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 15:24:08.819003 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.818997    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.819244 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.819224    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.819367 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.819349    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.819443 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.819370    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.819718 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.819697    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.821037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.820301    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbsfr\""
Jul 13 15:24:08.821037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.820319    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.821037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.820558    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.821037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.820598    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-km94k\""
Jul 13 15:24:08.821037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.820879    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lkpzc\""
Jul 13 15:24:08.822704 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.822686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.824188 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.823775    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.825525 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.825143    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 15:24:08.825525 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.825321    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.825525 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.825409    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:08.825525 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.825435    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.825525 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.825490    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pd4m2\""
Jul 13 15:24:08.827185 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.827158    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 15:24:08.827447 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.827430    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.827745 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.827692    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 15:24:08.828556 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.828419    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.829593 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.828820    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 15:24:08.829593 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.829039    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 15:24:08.830145 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.830129    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 15:24:08.830559 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.830538    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.831517 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.831489    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 15:24:08.831986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.831966    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 15:24:08.832159 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.832139    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 15:24:08.832288 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.832266    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xt9r9\""
Jul 13 15:24:08.832621 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.832588    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-64glw\""
Jul 13 15:24:08.833076 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.832654    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.841072 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841050    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-kubelet\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.841171 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-system-cni-dir\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.841171 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-modprobe-d\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.841171 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841143    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gptms\" (UniqueName: \"kubernetes.io/projected/a0533fed-e478-491d-9721-ce22dfb30bf5-kube-api-access-gptms\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:08.841333 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841170    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-etc-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.841333 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841193    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-cnibin\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.841333 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841225    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysctl-d\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.841333 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841248    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:08.841333 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841317    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-socket-dir-parent\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.841333 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841345    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-cni-bin\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.841649 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841369    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-kubelet\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.841649 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841394    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-run-netns\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.841649 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841476    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.841649 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841503    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcpcz\" (UniqueName: \"kubernetes.io/projected/349e9302-4c8e-4893-a508-34c88849f71e-kube-api-access-gcpcz\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.841649 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjrz\" (UniqueName: \"kubernetes.io/projected/77bb8670-d737-4ee3-acbb-948ef1edc73b-kube-api-access-hxjrz\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.841910 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.841910 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-systemd\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.841910 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841814    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-system-cni-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.841910 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841847    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c01fe0e-f95f-47b4-82c8-77e234befa3f-serviceca\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.842108 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841897    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77bb8670-d737-4ee3-acbb-948ef1edc73b-iptables-alerter-script\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.842108 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77bb8670-d737-4ee3-acbb-948ef1edc73b-host-slash\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.842108 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.841979    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-cnibin\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842108 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ws4\" (UniqueName: \"kubernetes.io/projected/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-kube-api-access-p7ws4\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842108 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4972f3e0-9154-4893-bd4a-f516b1ce678b-kubelet-config\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.842108 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842095    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-os-release\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842167    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-sys\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842231    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-var-lib-kubelet\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842256    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5grj\" (UniqueName: \"kubernetes.io/projected/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-kube-api-access-d5grj\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842321    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13320759-94ed-46fc-9340-294b88a9e1d2-agent-certs\") pod \"konnectivity-agent-fnpsb\" (UID: \"13320759-94ed-46fc-9340-294b88a9e1d2\") " pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842345    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-lib-modules\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b86d4a6b-eaca-402b-9d25-30e3815d8070-tmp\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-cni-binary-copy\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842414    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-k8s-cni-cncf-io\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842438    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-netns\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-log-socket\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842485    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4972f3e0-9154-4893-bd4a-f516b1ce678b-dbus\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842566    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13320759-94ed-46fc-9340-294b88a9e1d2-konnectivity-ca\") pod \"konnectivity-agent-fnpsb\" (UID: \"13320759-94ed-46fc-9340-294b88a9e1d2\") " pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-device-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842644    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbztg\" (UniqueName: \"kubernetes.io/projected/fa142aef-fab9-40a7-80d0-1631123bdf06-kube-api-access-mbztg\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-conf-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-daemon-config\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovnkube-config\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-etc-kubernetes\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842819    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-cni-netd\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-cni-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.842967 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-os-release\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.842979    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-ovn\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843003    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c01fe0e-f95f-47b4-82c8-77e234befa3f-host\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843027    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94fqd\" (UniqueName: \"kubernetes.io/projected/b86d4a6b-eaca-402b-9d25-30e3815d8070-kube-api-access-94fqd\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa142aef-fab9-40a7-80d0-1631123bdf06-tmp-dir\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-systemd\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843152    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-sys-fs\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-hostroot\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-multus-certs\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-systemd-units\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843322    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-node-log\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-cni-multus\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-slash\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-var-lib-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-cni-bin\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.843666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-env-overrides\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovn-node-metrics-cert\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843582    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzmqn\" (UniqueName: \"kubernetes.io/projected/4c01fe0e-f95f-47b4-82c8-77e234befa3f-kube-api-access-dzmqn\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysconfig\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-kubernetes\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843666    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysctl-conf\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-run\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843716    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-host\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-tuned\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843797    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-socket-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa142aef-fab9-40a7-80d0-1631123bdf06-hosts-file\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovnkube-script-lib\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-registration-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.843990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.844686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.844014    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9r9n\" (UniqueName: \"kubernetes.io/projected/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-kube-api-access-j9r9n\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.851676 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.851651    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 15:24:08.887799 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.887776    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4fzjh"
Jul 13 15:24:08.898681 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.898658    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4fzjh"
Jul 13 15:24:08.944692 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944649    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944706    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa142aef-fab9-40a7-80d0-1631123bdf06-hosts-file\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovnkube-script-lib\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944776    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-registration-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9r9n\" (UniqueName: \"kubernetes.io/projected/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-kube-api-access-j9r9n\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944855    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-kubelet\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-system-cni-dir\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944909    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-modprobe-d\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944935    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gptms\" (UniqueName: \"kubernetes.io/projected/a0533fed-e478-491d-9721-ce22dfb30bf5-kube-api-access-gptms\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944959    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-etc-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.944986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-cnibin\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945010    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysctl-d\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-socket-dir-parent\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945111    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-cni-bin\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945138    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-kubelet\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.945425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945165    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-run-netns\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945191    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcpcz\" (UniqueName: \"kubernetes.io/projected/349e9302-4c8e-4893-a508-34c88849f71e-kube-api-access-gcpcz\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945246    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjrz\" (UniqueName: \"kubernetes.io/projected/77bb8670-d737-4ee3-acbb-948ef1edc73b-kube-api-access-hxjrz\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-systemd\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945319    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-system-cni-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945363    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c01fe0e-f95f-47b4-82c8-77e234befa3f-serviceca\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945392    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77bb8670-d737-4ee3-acbb-948ef1edc73b-iptables-alerter-script\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945419    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77bb8670-d737-4ee3-acbb-948ef1edc73b-host-slash\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-cnibin\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945467    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ws4\" (UniqueName: \"kubernetes.io/projected/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-kube-api-access-p7ws4\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945518    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4972f3e0-9154-4893-bd4a-f516b1ce678b-kubelet-config\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945549    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945578    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-os-release\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945609    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945636    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-sys\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.946326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-var-lib-kubelet\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945691    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945719    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5grj\" (UniqueName: \"kubernetes.io/projected/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-kube-api-access-d5grj\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945745    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13320759-94ed-46fc-9340-294b88a9e1d2-agent-certs\") pod \"konnectivity-agent-fnpsb\" (UID: \"13320759-94ed-46fc-9340-294b88a9e1d2\") " pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-lib-modules\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945787    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovnkube-script-lib\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b86d4a6b-eaca-402b-9d25-30e3815d8070-tmp\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945832    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-cni-binary-copy\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945902    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-registration-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-k8s-cni-cncf-io\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945963    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-netns\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-log-socket\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946015    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4972f3e0-9154-4893-bd4a-f516b1ce678b-dbus\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13320759-94ed-46fc-9340-294b88a9e1d2-konnectivity-ca\") pod \"konnectivity-agent-fnpsb\" (UID: \"13320759-94ed-46fc-9340-294b88a9e1d2\") " pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-device-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbztg\" (UniqueName: \"kubernetes.io/projected/fa142aef-fab9-40a7-80d0-1631123bdf06-kube-api-access-mbztg\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946126    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-conf-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.947234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946155    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-daemon-config\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovnkube-config\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946211    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-etc-kubernetes\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946226    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946239    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-cni-netd\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946267    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-cni-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946329    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-os-release\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-ovn\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946399    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c01fe0e-f95f-47b4-82c8-77e234befa3f-host\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94fqd\" (UniqueName: \"kubernetes.io/projected/b86d4a6b-eaca-402b-9d25-30e3815d8070-kube-api-access-94fqd\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946429    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-cni-binary-copy\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa142aef-fab9-40a7-80d0-1631123bdf06-tmp-dir\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946484    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946494    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-system-cni-dir\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-systemd\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946534    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-sys-fs\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.948088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-hostroot\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-multus-certs\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946610    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-systemd-units\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946614    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-modprobe-d\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946638    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-node-log\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946692    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-cni-multus\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946723    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-slash\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-var-lib-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946774    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-cni-bin\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946801    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-env-overrides\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovn-node-metrics-cert\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946864    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13320759-94ed-46fc-9340-294b88a9e1d2-konnectivity-ca\") pod \"konnectivity-agent-fnpsb\" (UID: \"13320759-94ed-46fc-9340-294b88a9e1d2\") " pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946939    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-etc-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-device-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.946983    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzmqn\" (UniqueName: \"kubernetes.io/projected/4c01fe0e-f95f-47b4-82c8-77e234befa3f-kube-api-access-dzmqn\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.949941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysconfig\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-kubernetes\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysctl-conf\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947066    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysctl-d\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947091    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-run\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947117    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-host\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-tuned\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.947157    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947169    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-socket-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947225    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.947265    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs podName:a0533fed-e478-491d-9721-ce22dfb30bf5 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.447233979 +0000 UTC m=+3.007924470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs") pod "network-metrics-daemon-vfdrs" (UID: "a0533fed-e478-491d-9721-ce22dfb30bf5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947375    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-socket-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947404    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-socket-dir-parent\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947466    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-netns\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947514    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-log-socket\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-conf-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947629    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-kubelet\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.950864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947650    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4972f3e0-9154-4893-bd4a-f516b1ce678b-dbus\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947693    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-kubelet\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947699    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-cni-bin\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-run-netns\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.945166    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa142aef-fab9-40a7-80d0-1631123bdf06-hosts-file\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.947768    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948101    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-daemon-config\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948166    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-node-log\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948212    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-var-lib-cni-multus\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948274    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-slash\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948272    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-multus-cni-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948314    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-etc-kubernetes\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948331    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-var-lib-openvswitch\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948363    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovnkube-config\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948387    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-cni-netd\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948437    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-cni-bin\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948767    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948819    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-cni-binary-copy\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.951671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948841    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-systemd\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948927    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-multus-certs\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948942    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948981    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-systemd-units\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949010    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-sys-fs\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949027    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-ovn\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.949091    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949092    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-os-release\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.949152    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret podName:4972f3e0-9154-4893-bd4a-f516b1ce678b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.449130305 +0000 UTC m=+3.009820787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret") pod "global-pull-secret-syncer-45g28" (UID: "4972f3e0-9154-4893-bd4a-f516b1ce678b") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949335    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-os-release\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.948894    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-hostroot\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949440    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949489    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-run-systemd\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949568    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949579    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa142aef-fab9-40a7-80d0-1631123bdf06-tmp-dir\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949625    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-sys\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949760    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-lib-modules\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949746    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 15:24:08.952625 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949935    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4972f3e0-9154-4893-bd4a-f516b1ce678b-kubelet-config\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.949993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-cnibin\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950049    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-kubernetes\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950090    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4c01fe0e-f95f-47b4-82c8-77e234befa3f-serviceca\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950168    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-var-lib-kubelet\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950236    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77bb8670-d737-4ee3-acbb-948ef1edc73b-iptables-alerter-script\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950301    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-run\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950360    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysctl-conf\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950374    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-host-run-k8s-cni-cncf-io\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950423    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/349e9302-4c8e-4893-a508-34c88849f71e-cnibin\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-host\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c01fe0e-f95f-47b4-82c8-77e234befa3f-host\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950602    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-system-cni-dir\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950648    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77bb8670-d737-4ee3-acbb-948ef1edc73b-host-slash\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-sysconfig\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.950980    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-env-overrides\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.953498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.951002    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/349e9302-4c8e-4893-a508-34c88849f71e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:08.954353 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.954320    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:08.954415 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.954358    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:08.954415 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.954374    2556 projected.go:196] Error preparing data for projected volume kube-api-access-42hwt for pod openshift-network-diagnostics/network-check-target-jr97l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:08.954518 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:08.954431    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt podName:90c1d775-ac5d-4ded-9ba5-938aaa280e26 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.45441484 +0000 UTC m=+3.015105330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-42hwt" (UniqueName: "kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt") pod "network-check-target-jr97l" (UID: "90c1d775-ac5d-4ded-9ba5-938aaa280e26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:08.955554 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.955478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b86d4a6b-eaca-402b-9d25-30e3815d8070-etc-tuned\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.955702 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.955654    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13320759-94ed-46fc-9340-294b88a9e1d2-agent-certs\") pod \"konnectivity-agent-fnpsb\" (UID: \"13320759-94ed-46fc-9340-294b88a9e1d2\") " pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:08.955907 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.955852    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b86d4a6b-eaca-402b-9d25-30e3815d8070-tmp\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.956663 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.956636    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-ovn-node-metrics-cert\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.959249 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.959227    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gptms\" (UniqueName: \"kubernetes.io/projected/a0533fed-e478-491d-9721-ce22dfb30bf5-kube-api-access-gptms\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:08.960925 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.960898    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9r9n\" (UniqueName: \"kubernetes.io/projected/a55a40ea-aa64-4793-b2f6-56b1acb00fd5-kube-api-access-j9r9n\") pod \"aws-ebs-csi-driver-node-8dtjs\" (UID: \"a55a40ea-aa64-4793-b2f6-56b1acb00fd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:08.961448 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.961426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbztg\" (UniqueName: \"kubernetes.io/projected/fa142aef-fab9-40a7-80d0-1631123bdf06-kube-api-access-mbztg\") pod \"node-resolver-26hm5\" (UID: \"fa142aef-fab9-40a7-80d0-1631123bdf06\") " pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:08.965311 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.965266    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ws4\" (UniqueName: \"kubernetes.io/projected/38aa5c7d-b417-4df7-ba26-2a19ec55a03d-kube-api-access-p7ws4\") pod \"multus-678q9\" (UID: \"38aa5c7d-b417-4df7-ba26-2a19ec55a03d\") " pod="openshift-multus/multus-678q9"
Jul 13 15:24:08.967975 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.967851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzmqn\" (UniqueName: \"kubernetes.io/projected/4c01fe0e-f95f-47b4-82c8-77e234befa3f-kube-api-access-dzmqn\") pod \"node-ca-2xltf\" (UID: \"4c01fe0e-f95f-47b4-82c8-77e234befa3f\") " pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:08.967975 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.967866    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5grj\" (UniqueName: \"kubernetes.io/projected/cecbcd74-fdb3-490e-a8cc-2fd7601f44d0-kube-api-access-d5grj\") pod \"ovnkube-node-v745k\" (UID: \"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:08.968328 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.968304    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94fqd\" (UniqueName: \"kubernetes.io/projected/b86d4a6b-eaca-402b-9d25-30e3815d8070-kube-api-access-94fqd\") pod \"tuned-wbn4v\" (UID: \"b86d4a6b-eaca-402b-9d25-30e3815d8070\") " pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:08.974713 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.974687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjrz\" (UniqueName: \"kubernetes.io/projected/77bb8670-d737-4ee3-acbb-948ef1edc73b-kube-api-access-hxjrz\") pod \"iptables-alerter-rrfqw\" (UID: \"77bb8670-d737-4ee3-acbb-948ef1edc73b\") " pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:08.974860 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:08.974840    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcpcz\" (UniqueName: \"kubernetes.io/projected/349e9302-4c8e-4893-a508-34c88849f71e-kube-api-access-gcpcz\") pod \"multus-additional-cni-plugins-g9vqf\" (UID: \"349e9302-4c8e-4893-a508-34c88849f71e\") " pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:09.080207 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.080094    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" event={"ID":"6f6bd2ba4ae233da88135071168265b2","Type":"ContainerStarted","Data":"07593e6961e9fef045a1c222851003d98a57a719219bc1a6b8b484ec41a3e8ff"}
Jul 13 15:24:09.082080 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.082050    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"e8192ca88aa5f8bffc58c5b17fd60492","Type":"ContainerStarted","Data":"3e732e8844fdd399e31d7c88b1cbb93028535968f3df3d5dc6f97783bf65d62c"}
Jul 13 15:24:09.124498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.124456    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wbn4v"
Jul 13 15:24:09.137007 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.136945    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:09.145273 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:09.141656    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86d4a6b_eaca_402b_9d25_30e3815d8070.slice/crio-87246ef1b47b71894dbe46e6199d1c790c5daedbb26fc091bb034eeba873b2b4 WatchSource:0}: Error finding container 87246ef1b47b71894dbe46e6199d1c790c5daedbb26fc091bb034eeba873b2b4: Status 404 returned error can't find the container with id 87246ef1b47b71894dbe46e6199d1c790c5daedbb26fc091bb034eeba873b2b4
Jul 13 15:24:09.147203 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.147182    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g9vqf"
Jul 13 15:24:09.150008 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:09.149922    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13320759_94ed_46fc_9340_294b88a9e1d2.slice/crio-6f2080f6c58d75263029567cfed57b7b3792d67a5a9368f2b44da9b2756c4357 WatchSource:0}: Error finding container 6f2080f6c58d75263029567cfed57b7b3792d67a5a9368f2b44da9b2756c4357: Status 404 returned error can't find the container with id 6f2080f6c58d75263029567cfed57b7b3792d67a5a9368f2b44da9b2756c4357
Jul 13 15:24:09.153211 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.153176    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs"
Jul 13 15:24:09.158618 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:09.158591    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349e9302_4c8e_4893_a508_34c88849f71e.slice/crio-5b669d02280e3ec12e77ea384911e59eaf596e5c86e78fb32fdb0fdff1f19187 WatchSource:0}: Error finding container 5b669d02280e3ec12e77ea384911e59eaf596e5c86e78fb32fdb0fdff1f19187: Status 404 returned error can't find the container with id 5b669d02280e3ec12e77ea384911e59eaf596e5c86e78fb32fdb0fdff1f19187
Jul 13 15:24:09.162874 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.162852    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26hm5"
Jul 13 15:24:09.164740 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:09.164678    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55a40ea_aa64_4793_b2f6_56b1acb00fd5.slice/crio-a15258e4af79cbf2ee64e8c1368860f8359a0ce4ee3ba465b5af81b209ed5ab6 WatchSource:0}: Error finding container a15258e4af79cbf2ee64e8c1368860f8359a0ce4ee3ba465b5af81b209ed5ab6: Status 404 returned error can't find the container with id a15258e4af79cbf2ee64e8c1368860f8359a0ce4ee3ba465b5af81b209ed5ab6
Jul 13 15:24:09.173363 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.173341    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2xltf"
Jul 13 15:24:09.173878 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:09.173847    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa142aef_fab9_40a7_80d0_1631123bdf06.slice/crio-9ff84c3a05ae636e772cece4b143aa4de382fbc961ed3223235624931a066785 WatchSource:0}: Error finding container 9ff84c3a05ae636e772cece4b143aa4de382fbc961ed3223235624931a066785: Status 404 returned error can't find the container with id 9ff84c3a05ae636e772cece4b143aa4de382fbc961ed3223235624931a066785
Jul 13 15:24:09.182016 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.181994    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-678q9"
Jul 13 15:24:09.193816 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.193787    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrfqw"
Jul 13 15:24:09.200286 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.200252    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:09.202639 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.202621    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:09.451348 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.451306    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:09.451572 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.451372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:09.451572 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.451493    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:09.451572 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.451515    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:09.451740 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.451576    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret podName:4972f3e0-9154-4893-bd4a-f516b1ce678b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.451556422 +0000 UTC m=+4.012246893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret") pod "global-pull-secret-syncer-45g28" (UID: "4972f3e0-9154-4893-bd4a-f516b1ce678b") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:09.451740 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.451597    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs podName:a0533fed-e478-491d-9721-ce22dfb30bf5 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.451586999 +0000 UTC m=+4.012277466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs") pod "network-metrics-daemon-vfdrs" (UID: "a0533fed-e478-491d-9721-ce22dfb30bf5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:09.539487 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:09.539458    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c01fe0e_f95f_47b4_82c8_77e234befa3f.slice/crio-f8dfd15d4b2dcea8dc4421b88f876d36eb9b86706692ce092820a91e198d086a WatchSource:0}: Error finding container f8dfd15d4b2dcea8dc4421b88f876d36eb9b86706692ce092820a91e198d086a: Status 404 returned error can't find the container with id f8dfd15d4b2dcea8dc4421b88f876d36eb9b86706692ce092820a91e198d086a
Jul 13 15:24:09.552562 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.552536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:09.552734 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.552714    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:09.552788 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.552742    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:09.552788 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.552753    2556 projected.go:196] Error preparing data for projected volume kube-api-access-42hwt for pod openshift-network-diagnostics/network-check-target-jr97l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:09.552864 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:09.552806    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt podName:90c1d775-ac5d-4ded-9ba5-938aaa280e26 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.552789735 +0000 UTC m=+4.113480201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-42hwt" (UniqueName: "kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt") pod "network-check-target-jr97l" (UID: "90c1d775-ac5d-4ded-9ba5-938aaa280e26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:09.902580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.902345    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 15:19:09 +0000 UTC" deadline="2027-12-22 17:43:26.204705383 +0000 UTC"
Jul 13 15:24:09.902580 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:09.902391    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12650h19m16.302319542s"
Jul 13 15:24:10.073546 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.073511    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:10.074167 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.073668    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:10.074167 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.073969    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:10.074167 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.074090    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:10.086240 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.086209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnpsb" event={"ID":"13320759-94ed-46fc-9340-294b88a9e1d2","Type":"ContainerStarted","Data":"6f2080f6c58d75263029567cfed57b7b3792d67a5a9368f2b44da9b2756c4357"}
Jul 13 15:24:10.088357 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.088327    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wbn4v" event={"ID":"b86d4a6b-eaca-402b-9d25-30e3815d8070","Type":"ContainerStarted","Data":"87246ef1b47b71894dbe46e6199d1c790c5daedbb26fc091bb034eeba873b2b4"}
Jul 13 15:24:10.089881 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.089846    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2xltf" event={"ID":"4c01fe0e-f95f-47b4-82c8-77e234befa3f","Type":"ContainerStarted","Data":"f8dfd15d4b2dcea8dc4421b88f876d36eb9b86706692ce092820a91e198d086a"}
Jul 13 15:24:10.091804 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.091781    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26hm5" event={"ID":"fa142aef-fab9-40a7-80d0-1631123bdf06","Type":"ContainerStarted","Data":"9ff84c3a05ae636e772cece4b143aa4de382fbc961ed3223235624931a066785"}
Jul 13 15:24:10.093485 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.093458    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs" event={"ID":"a55a40ea-aa64-4793-b2f6-56b1acb00fd5","Type":"ContainerStarted","Data":"a15258e4af79cbf2ee64e8c1368860f8359a0ce4ee3ba465b5af81b209ed5ab6"}
Jul 13 15:24:10.095332 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.095300    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerStarted","Data":"5b669d02280e3ec12e77ea384911e59eaf596e5c86e78fb32fdb0fdff1f19187"}
Jul 13 15:24:10.414387 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:10.414331    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bb8670_d737_4ee3_acbb_948ef1edc73b.slice/crio-fc7e01c9546c9832c0f6f010adee8542cdc07eadc1cee9a797d4b92a694a03d5 WatchSource:0}: Error finding container fc7e01c9546c9832c0f6f010adee8542cdc07eadc1cee9a797d4b92a694a03d5: Status 404 returned error can't find the container with id fc7e01c9546c9832c0f6f010adee8542cdc07eadc1cee9a797d4b92a694a03d5
Jul 13 15:24:10.421559 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:10.421522    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38aa5c7d_b417_4df7_ba26_2a19ec55a03d.slice/crio-aeb555505b9c9e1dfe748e8a0b289fd4c0a25279aa375d5a07dbc34e6ddf69ab WatchSource:0}: Error finding container aeb555505b9c9e1dfe748e8a0b289fd4c0a25279aa375d5a07dbc34e6ddf69ab: Status 404 returned error can't find the container with id aeb555505b9c9e1dfe748e8a0b289fd4c0a25279aa375d5a07dbc34e6ddf69ab
Jul 13 15:24:10.462609 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.462576    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:10.462741 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.462677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:10.462821 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.462803    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:10.462883 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.462865    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs podName:a0533fed-e478-491d-9721-ce22dfb30bf5 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.462851201 +0000 UTC m=+6.023541668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs") pod "network-metrics-daemon-vfdrs" (UID: "a0533fed-e478-491d-9721-ce22dfb30bf5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:10.462960 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.462803    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:10.462960 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.462947    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret podName:4972f3e0-9154-4893-bd4a-f516b1ce678b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.462933766 +0000 UTC m=+6.023624254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret") pod "global-pull-secret-syncer-45g28" (UID: "4972f3e0-9154-4893-bd4a-f516b1ce678b") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:10.564082 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.563762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:10.564082 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.563962    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:10.564444 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.564093    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:10.564444 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.564111    2556 projected.go:196] Error preparing data for projected volume kube-api-access-42hwt for pod openshift-network-diagnostics/network-check-target-jr97l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:10.564444 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:10.564182    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt podName:90c1d775-ac5d-4ded-9ba5-938aaa280e26 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.564161974 +0000 UTC m=+6.124852443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-42hwt" (UniqueName: "kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt") pod "network-check-target-jr97l" (UID: "90c1d775-ac5d-4ded-9ba5-938aaa280e26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:10.902876 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.902775    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 15:19:09 +0000 UTC" deadline="2028-02-23 01:17:05.827044315 +0000 UTC"
Jul 13 15:24:10.902876 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:10.902841    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14145h52m54.924207766s"
Jul 13 15:24:11.075408 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:11.075276    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:11.076027 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:11.075454    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:11.100534 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:11.100495    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrfqw" event={"ID":"77bb8670-d737-4ee3-acbb-948ef1edc73b","Type":"ContainerStarted","Data":"fc7e01c9546c9832c0f6f010adee8542cdc07eadc1cee9a797d4b92a694a03d5"}
Jul 13 15:24:11.111177 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:11.111138    2556 generic.go:356] "Generic (PLEG): container finished" podID="e8192ca88aa5f8bffc58c5b17fd60492" containerID="140c48c375334c38e5be40f2bfc959b6d9b8985f24f2ce4dae50948f3ae0be4c" exitCode=0
Jul 13 15:24:11.111358 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:11.111247    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"e8192ca88aa5f8bffc58c5b17fd60492","Type":"ContainerDied","Data":"140c48c375334c38e5be40f2bfc959b6d9b8985f24f2ce4dae50948f3ae0be4c"}
Jul 13 15:24:11.114374 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:11.114330    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"2e0f60d3071b5c52810ea64cda71eb05aef6d5342dbac94f70d95053673076b6"}
Jul 13 15:24:11.118414 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:11.118385    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-678q9" event={"ID":"38aa5c7d-b417-4df7-ba26-2a19ec55a03d","Type":"ContainerStarted","Data":"aeb555505b9c9e1dfe748e8a0b289fd4c0a25279aa375d5a07dbc34e6ddf69ab"}
Jul 13 15:24:11.121108 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:11.121079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" event={"ID":"6f6bd2ba4ae233da88135071168265b2","Type":"ContainerStarted","Data":"03afbdc3d1bf9834b7c3f554fb4713d18c5b2f8fd0bcfedbe24dd5b6602f3078"}
Jul 13 15:24:12.073358 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:12.073203    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:12.073358 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:12.073235    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:12.073358 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.073364    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:12.073672 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.073462    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:12.480129 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:12.480088    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:12.480672 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:12.480145    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:12.480672 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.480295    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:12.480672 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.480352    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:12.480672 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.480374    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs podName:a0533fed-e478-491d-9721-ce22dfb30bf5 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.480350095 +0000 UTC m=+10.041040568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs") pod "network-metrics-daemon-vfdrs" (UID: "a0533fed-e478-491d-9721-ce22dfb30bf5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:12.480672 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.480412    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret podName:4972f3e0-9154-4893-bd4a-f516b1ce678b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.480393895 +0000 UTC m=+10.041084377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret") pod "global-pull-secret-syncer-45g28" (UID: "4972f3e0-9154-4893-bd4a-f516b1ce678b") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:12.581278 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:12.581249    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:12.581492 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.581416    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:12.581492 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.581436    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:12.581492 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.581448    2556 projected.go:196] Error preparing data for projected volume kube-api-access-42hwt for pod openshift-network-diagnostics/network-check-target-jr97l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:12.581696 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:12.581517    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt podName:90c1d775-ac5d-4ded-9ba5-938aaa280e26 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.581495024 +0000 UTC m=+10.142185506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-42hwt" (UniqueName: "kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt") pod "network-check-target-jr97l" (UID: "90c1d775-ac5d-4ded-9ba5-938aaa280e26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:13.072719 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:13.072685    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:13.072914 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:13.072882    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:14.073451 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:14.073409    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:14.073889 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:14.073409    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:14.073889 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:14.073549    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:14.073889 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:14.073676    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:15.073290 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:15.072765    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:15.073290 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:15.072918    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:16.072735 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:16.072591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:16.072735 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:16.072609    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:16.072735 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.072729    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:16.073375 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.072826    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:16.513988 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:16.513951    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:16.514177 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:16.514004    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:16.514177 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.514129    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:16.514336 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.514188    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret podName:4972f3e0-9154-4893-bd4a-f516b1ce678b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.514170842 +0000 UTC m=+18.074861310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret") pod "global-pull-secret-syncer-45g28" (UID: "4972f3e0-9154-4893-bd4a-f516b1ce678b") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:16.514336 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.514302    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:16.514462 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.514376    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs podName:a0533fed-e478-491d-9721-ce22dfb30bf5 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.514357213 +0000 UTC m=+18.075047695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs") pod "network-metrics-daemon-vfdrs" (UID: "a0533fed-e478-491d-9721-ce22dfb30bf5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:16.616025 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:16.615396    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:16.616025 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.615595    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:16.616025 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.615614    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:16.616025 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.615626    2556 projected.go:196] Error preparing data for projected volume kube-api-access-42hwt for pod openshift-network-diagnostics/network-check-target-jr97l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:16.616025 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:16.615684    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt podName:90c1d775-ac5d-4ded-9ba5-938aaa280e26 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.615666664 +0000 UTC m=+18.176357132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-42hwt" (UniqueName: "kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt") pod "network-check-target-jr97l" (UID: "90c1d775-ac5d-4ded-9ba5-938aaa280e26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:17.074887 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:17.074335    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:17.074887 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:17.074464    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:18.072834 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:18.072755    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:18.072991 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:18.072885    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:18.073057 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:18.073035    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:18.073151 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:18.073130    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:19.072836 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.072802    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:19.073359 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:19.072949    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:19.140742 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.140704    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnpsb" event={"ID":"13320759-94ed-46fc-9340-294b88a9e1d2","Type":"ContainerStarted","Data":"8bd74da84ad67ab9dceae400d1f7588ea846eb720448c37b559b256094284975"}
Jul 13 15:24:19.143350 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.143321    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wbn4v" event={"ID":"b86d4a6b-eaca-402b-9d25-30e3815d8070","Type":"ContainerStarted","Data":"e32c59389fb0755007a385ab562374cd37583558cf503ed4615404a7f9a59320"}
Jul 13 15:24:19.145854 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.145817    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"e8192ca88aa5f8bffc58c5b17fd60492","Type":"ContainerStarted","Data":"71cf8219e755ec3fbc67b50b1cc6ed160b103b98609e1892985a7b4042f3dc07"}
Jul 13 15:24:19.147821 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.147765    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs" event={"ID":"a55a40ea-aa64-4793-b2f6-56b1acb00fd5","Type":"ContainerStarted","Data":"4dc631f029d534f07d88d1469754e0fb31a049fdb490109b519125979d001a35"}
Jul 13 15:24:19.149731 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.149708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2xltf" event={"ID":"4c01fe0e-f95f-47b4-82c8-77e234befa3f","Type":"ContainerStarted","Data":"5bd02f9c3b24261d6dc4ddb248e9c43397eb1956b79125415d4948347a3a4f6a"}
Jul 13 15:24:19.151676 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.151651    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26hm5" event={"ID":"fa142aef-fab9-40a7-80d0-1631123bdf06","Type":"ContainerStarted","Data":"a8d8fc63a01cae2fea9ba7af4aa5fb832277a85e3372559042531fde398ad6ab"}
Jul 13 15:24:19.153653 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.153579    2556 generic.go:356] "Generic (PLEG): container finished" podID="349e9302-4c8e-4893-a508-34c88849f71e" containerID="2aac534434f0bfdf64e2fae8400f151bfd3bb81aab0d2f92c97de7a32d3d6b32" exitCode=0
Jul 13 15:24:19.153653 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.153614    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerDied","Data":"2aac534434f0bfdf64e2fae8400f151bfd3bb81aab0d2f92c97de7a32d3d6b32"}
Jul 13 15:24:19.158313 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.158251    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" podStartSLOduration=11.158234408 podStartE2EDuration="11.158234408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:11.155006441 +0000 UTC m=+4.715696933" watchObservedRunningTime="2026-07-13 15:24:19.158234408 +0000 UTC m=+12.718924896"
Jul 13 15:24:19.158899 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.158811    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fnpsb" podStartSLOduration=2.584661942 podStartE2EDuration="12.158800686s" totalImagesPullingTime="9.574138744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.157940018 +0000 UTC m=+12.718630506" watchObservedRunningTime="2026-07-13 15:24:19.158800686 +0000 UTC m=+12.719491215"
Jul 13 15:24:19.191767 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.191712    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wbn4v" podStartSLOduration=2.556811907 podStartE2EDuration="12.19169153s" totalImagesPullingTime="9.634879623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.191407427 +0000 UTC m=+12.752097915" watchObservedRunningTime="2026-07-13 15:24:19.19169153 +0000 UTC m=+12.752382018"
Jul 13 15:24:19.191939 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.191896    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" podStartSLOduration=11.191887697 podStartE2EDuration="11.191887697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.174325731 +0000 UTC m=+12.735016219" watchObservedRunningTime="2026-07-13 15:24:19.191887697 +0000 UTC m=+12.752578185"
Jul 13 15:24:19.246281 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.246166    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-26hm5" podStartSLOduration=3.6126605400000003 podStartE2EDuration="12.246148256s" totalImagesPullingTime="8.633487716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.245875178 +0000 UTC m=+12.806565666" watchObservedRunningTime="2026-07-13 15:24:19.246148256 +0000 UTC m=+12.806838744"
Jul 13 15:24:19.261764 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:19.261705    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2xltf" podStartSLOduration=3.044248146 podStartE2EDuration="12.261683916s" totalImagesPullingTime="9.21743577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.261655377 +0000 UTC m=+12.822345911" watchObservedRunningTime="2026-07-13 15:24:19.261683916 +0000 UTC m=+12.822374404"
Jul 13 15:24:20.072640 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:20.072612    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:20.072640 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:20.072625    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:20.072856 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:20.072722    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:20.073205 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:20.072859    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:21.073531 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:21.073218    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:21.073913 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:21.073606    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:21.160435 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:21.160389    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrfqw" event={"ID":"77bb8670-d737-4ee3-acbb-948ef1edc73b","Type":"ContainerStarted","Data":"ed5dfbe929884754c596aff9e0c9674e4c43475f359836874f2912db273fc01c"}
Jul 13 15:24:21.425425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:21.425393    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:21.425957 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:21.425935    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:21.451822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:21.451768    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrfqw" podStartSLOduration=6.116242063 podStartE2EDuration="14.451754871s" totalImagesPullingTime="8.335512808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:21.177052274 +0000 UTC m=+14.737742758" watchObservedRunningTime="2026-07-13 15:24:21.451754871 +0000 UTC m=+15.012445359"
Jul 13 15:24:22.072888 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:22.072854    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:22.073111 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:22.072977    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:22.073111 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:22.073036    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:22.073221 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:22.073175    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:22.218062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:22.218033    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26hm5_fa142aef-fab9-40a7-80d0-1631123bdf06/dns-node-resolver/0.log"
Jul 13 15:24:23.073082 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:23.073050    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:23.073282 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:23.073199    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:23.166667 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:23.166642    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2xltf_4c01fe0e-f95f-47b4-82c8-77e234befa3f/node-ca/0.log"
Jul 13 15:24:24.073627 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.073594    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:24.074304 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.073637    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:24.074304 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.073721    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:24.074304 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.073844    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:24.581559 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.581529    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:24.581741 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.581574    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:24.581741 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.581668    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:24.581741 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.581673    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:24.581741 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.581715    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret podName:4972f3e0-9154-4893-bd4a-f516b1ce678b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.581701629 +0000 UTC m=+34.142392107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret") pod "global-pull-secret-syncer-45g28" (UID: "4972f3e0-9154-4893-bd4a-f516b1ce678b") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:24.581741 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.581733    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs podName:a0533fed-e478-491d-9721-ce22dfb30bf5 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.581725464 +0000 UTC m=+34.142415930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs") pod "network-metrics-daemon-vfdrs" (UID: "a0533fed-e478-491d-9721-ce22dfb30bf5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:24.682662 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.682624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:24.682826 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.682792    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:24.682826 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.682812    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:24.682826 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.682825    2556 projected.go:196] Error preparing data for projected volume kube-api-access-42hwt for pod openshift-network-diagnostics/network-check-target-jr97l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:24.682964 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:24.682883    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt podName:90c1d775-ac5d-4ded-9ba5-938aaa280e26 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.682866715 +0000 UTC m=+34.243557180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-42hwt" (UniqueName: "kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt") pod "network-check-target-jr97l" (UID: "90c1d775-ac5d-4ded-9ba5-938aaa280e26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:24.851168 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.851079    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:24.851337 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.851215    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 15:24:24.851785 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:24.851736    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fnpsb"
Jul 13 15:24:25.072873 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:25.072839    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:25.073051 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:25.072987    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:26.073247 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:26.073204    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:26.073844 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:26.073255    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:26.073844 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:26.073354    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:26.073844 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:26.073475    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:27.073690 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:27.073656    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:27.074102 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:27.073785    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:28.072699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:28.072655    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:28.072860 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:28.072789    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:28.072860 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:28.072822    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:28.072983 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:28.072945    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:28.740401 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:28.740203    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 15:24:28.923724 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:28.923548    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T15:24:28.740384883Z","UUID":"2b5f4834-d560-434d-a2b3-9d47afc4baea","Handler":null,"Name":"","Endpoint":""}
Jul 13 15:24:28.925367 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:28.925341    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 15:24:28.925500 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:28.925389    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 15:24:29.073644 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:29.073610    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:29.073804 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:29.073743    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:29.178281 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:29.178194    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-678q9" event={"ID":"38aa5c7d-b417-4df7-ba26-2a19ec55a03d","Type":"ContainerStarted","Data":"5f1e1b0163eadc181a343c3d6e256b6d4676b271aa77b77e139d6593a4204f69"}
Jul 13 15:24:29.180515 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:29.180488    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs" event={"ID":"a55a40ea-aa64-4793-b2f6-56b1acb00fd5","Type":"ContainerStarted","Data":"24ea1d11b1dabdb5e72704e70b2ede4dd45880b3f89199d2dc34232cdee64ebc"}
Jul 13 15:24:29.201689 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:29.201647    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-678q9" podStartSLOduration=4.017911153 podStartE2EDuration="22.201634673s" totalImagesPullingTime="18.18372352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:29.201432163 +0000 UTC m=+22.762122655" watchObservedRunningTime="2026-07-13 15:24:29.201634673 +0000 UTC m=+22.762325160"
Jul 13 15:24:30.072831 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.072621    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:30.073328 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.072627    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:30.073328 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:30.072996    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:30.073438 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:30.073254    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:30.185946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.185922    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:24:30.186316 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.186258    2556 generic.go:356] "Generic (PLEG): container finished" podID="cecbcd74-fdb3-490e-a8cc-2fd7601f44d0" containerID="ca6cdff1da2a384642528eacb3bd6aa135df9ab352d02c36ca9d19d27b821794" exitCode=1
Jul 13 15:24:30.186316 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.186304    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"f67ad40c6da8008c50fbb640f6f8e5e888527031c418610d740698ba33739d4e"}
Jul 13 15:24:30.186535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.186371    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"b5a943e382bda1cabe16599e21a723b6b74325957f0197e7f9ff11cc1c19507b"}
Jul 13 15:24:30.186535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.186416    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"4008f03587b1f114c3752fe9938c240e0a081e668f4f2ff3d2b64263e94d9c85"}
Jul 13 15:24:30.186535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.186455    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"ec4c5bf5d2b5f34661332657c6826f6770d1d8f9d8a2f35a3b22641f13d5cd4c"}
Jul 13 15:24:30.186535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.186487    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerDied","Data":"ca6cdff1da2a384642528eacb3bd6aa135df9ab352d02c36ca9d19d27b821794"}
Jul 13 15:24:30.186535 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:30.186521    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"fb431c34043cf131cbf2c550b679f449f743f1d94458199d31bc2ebf8e1b281d"}
Jul 13 15:24:31.072956 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:31.072926    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:31.073492 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:31.073080    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:31.190538 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:31.190504    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs" event={"ID":"a55a40ea-aa64-4793-b2f6-56b1acb00fd5","Type":"ContainerStarted","Data":"172c12ddbf16b9eaef0bc05cd759c7b5d73bfc51168c46aca2dde9e9738f69cc"}
Jul 13 15:24:31.212739 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:31.212684    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dtjs" podStartSLOduration=3.695250124 podStartE2EDuration="24.212665378s" totalImagesPullingTime="20.517415254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:31.212328861 +0000 UTC m=+24.773019348" watchObservedRunningTime="2026-07-13 15:24:31.212665378 +0000 UTC m=+24.773355869"
Jul 13 15:24:32.072962 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:32.072934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:32.073391 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:32.072938    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:32.073391 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:32.073073    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:32.073391 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:32.073141    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:33.073127 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:33.073093    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:33.073673 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:33.073218    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:33.197756 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:33.197731    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:24:33.198135 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:33.198112    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"3b5a434d8c0bcc645b843138c2b9d7ba66c7baaa7c851711c2f8618faff964dd"}
Jul 13 15:24:33.199728 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:33.199696    2556 generic.go:356] "Generic (PLEG): container finished" podID="349e9302-4c8e-4893-a508-34c88849f71e" containerID="85b8e2964bff71a0c6b94a35e6455ed739ece8ca02c6d800acfd255762585602" exitCode=0
Jul 13 15:24:33.199847 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:33.199726    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerDied","Data":"85b8e2964bff71a0c6b94a35e6455ed739ece8ca02c6d800acfd255762585602"}
Jul 13 15:24:34.072940 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:34.072903    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:34.073132 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:34.072903    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:34.073132 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:34.073055    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:34.073132 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:34.073099    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:35.076494 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.076302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:35.077170 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:35.076593    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:35.207077 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.207051    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:24:35.207431 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.207408    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"f0826f3e2d1528a21f445320f65fc55b9113f8fb857030481d156d1eec950736"}
Jul 13 15:24:35.207749 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.207723    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:35.207852 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.207834    2556 scope.go:117] "RemoveContainer" containerID="ca6cdff1da2a384642528eacb3bd6aa135df9ab352d02c36ca9d19d27b821794"
Jul 13 15:24:35.209592 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.209572    2556 generic.go:356] "Generic (PLEG): container finished" podID="349e9302-4c8e-4893-a508-34c88849f71e" containerID="34e1ea1169193ede8d2854fcba5552c3896e61629f5040809e32bbadc0a3368b" exitCode=0
Jul 13 15:24:35.209691 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.209601    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerDied","Data":"34e1ea1169193ede8d2854fcba5552c3896e61629f5040809e32bbadc0a3368b"}
Jul 13 15:24:35.224383 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:35.224363    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:36.072992 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.072963    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:36.073139 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:36.073069    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:36.073139 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.073124    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:36.073231 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:36.073211    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:36.216576 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.216549    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:24:36.216987 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.216909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" event={"ID":"cecbcd74-fdb3-490e-a8cc-2fd7601f44d0","Type":"ContainerStarted","Data":"a8afd34849f13da9dd3b0c278fd4ebabe27660d0ee6544d8a975f178b6839d5d"}
Jul 13 15:24:36.217179 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.217152    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:36.217316 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.217238    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:36.232454 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.232432    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:24:36.257239 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:36.257190    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v745k" podStartSLOduration=10.540302208 podStartE2EDuration="29.25717605s" totalImagesPullingTime="18.716873842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:36.255335572 +0000 UTC m=+29.816026061" watchObservedRunningTime="2026-07-13 15:24:36.25717605 +0000 UTC m=+29.817866536"
Jul 13 15:24:37.075558 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:37.075489    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:37.075683 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:37.075584    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:37.221447 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:37.221408    2556 generic.go:356] "Generic (PLEG): container finished" podID="349e9302-4c8e-4893-a508-34c88849f71e" containerID="346ce3ef63cb304348411f28b00397fdbfede6fee4208b491d907f0162616c35" exitCode=0
Jul 13 15:24:37.221875 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:37.221486    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerDied","Data":"346ce3ef63cb304348411f28b00397fdbfede6fee4208b491d907f0162616c35"}
Jul 13 15:24:38.073486 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:38.073452    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:38.073486 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:38.073468    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:38.073686 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:38.073554    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:38.073738 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:38.073679    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:39.073259 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:39.073225    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:39.073672 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:39.073386    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:40.073522 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:40.073486    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:40.073958 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:40.073540    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:40.073958 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.073622    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:40.073958 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.073764    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:40.603475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:40.603439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:40.603646 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:40.603493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:40.603646 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.603607    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:40.603741 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.603665    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs podName:a0533fed-e478-491d-9721-ce22dfb30bf5 nodeName:}" failed. No retries permitted until 2026-07-13 15:25:12.603651454 +0000 UTC m=+66.164341925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs") pod "network-metrics-daemon-vfdrs" (UID: "a0533fed-e478-491d-9721-ce22dfb30bf5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:40.603741 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.603607    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:40.603741 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.603738    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret podName:4972f3e0-9154-4893-bd4a-f516b1ce678b nodeName:}" failed. No retries permitted until 2026-07-13 15:25:12.603726058 +0000 UTC m=+66.164416524 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret") pod "global-pull-secret-syncer-45g28" (UID: "4972f3e0-9154-4893-bd4a-f516b1ce678b") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:40.704604 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:40.704568    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:40.704776 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.704699    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:40.704776 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.704726    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:40.704776 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.704735    2556 projected.go:196] Error preparing data for projected volume kube-api-access-42hwt for pod openshift-network-diagnostics/network-check-target-jr97l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:40.704910 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:40.704797    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt podName:90c1d775-ac5d-4ded-9ba5-938aaa280e26 nodeName:}" failed. No retries permitted until 2026-07-13 15:25:12.704778131 +0000 UTC m=+66.265468602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-42hwt" (UniqueName: "kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt") pod "network-check-target-jr97l" (UID: "90c1d775-ac5d-4ded-9ba5-938aaa280e26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:41.073478 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:41.073448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:41.073681 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:41.073578    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:42.072917 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:42.072891    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:42.073068 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:42.072934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:42.073068 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:42.073039    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:42.073153 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:42.073136    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:42.235841 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:42.235814    2556 generic.go:356] "Generic (PLEG): container finished" podID="349e9302-4c8e-4893-a508-34c88849f71e" containerID="ae4a17b49857ccef24b832fb4b3f99b3e9089ee0f086547235a4dad769c59353" exitCode=0
Jul 13 15:24:42.236305 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:42.235847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerDied","Data":"ae4a17b49857ccef24b832fb4b3f99b3e9089ee0f086547235a4dad769c59353"}
Jul 13 15:24:43.073126 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:43.073097    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:43.073305 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:43.073200    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:43.240969 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:43.240938    2556 generic.go:356] "Generic (PLEG): container finished" podID="349e9302-4c8e-4893-a508-34c88849f71e" containerID="9c71c787cd072ab93e12f6f9b1acaf63e48fa2983032153e31cdb07d774ef8cb" exitCode=0
Jul 13 15:24:43.241345 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:43.240994    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerDied","Data":"9c71c787cd072ab93e12f6f9b1acaf63e48fa2983032153e31cdb07d774ef8cb"}
Jul 13 15:24:43.985703 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:43.985663    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jr97l"]
Jul 13 15:24:43.985897 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:43.985782    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:43.985897 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:43.985886    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:43.992808 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:43.992771    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vfdrs"]
Jul 13 15:24:43.992954 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:43.992883    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:43.993016 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:43.992984    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:44.018516 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:44.018445    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45g28"]
Jul 13 15:24:44.018632 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:44.018563    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:44.018667 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:44.018646    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:44.246649 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:44.246464    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" event={"ID":"349e9302-4c8e-4893-a508-34c88849f71e","Type":"ContainerStarted","Data":"b28153ed3043c3ba186c6b4e9274fe85e10e6f196da35b2b710cc28c84b1d2f2"}
Jul 13 15:24:44.276341 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:44.276217    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g9vqf" podStartSLOduration=7.162825058 podStartE2EDuration="37.276203175s" totalImagesPullingTime="30.113378117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:44.275495705 +0000 UTC m=+37.836186192" watchObservedRunningTime="2026-07-13 15:24:44.276203175 +0000 UTC m=+37.836893697"
Jul 13 15:24:45.072947 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:45.072906    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:45.073146 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:45.073033    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:46.073258 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:46.073230    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:46.073632 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:46.073230    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:46.073632 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:46.073344    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:46.073632 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:46.073400    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:47.073776 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:47.073744    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:47.074383 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:47.073829    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfdrs" podUID="a0533fed-e478-491d-9721-ce22dfb30bf5"
Jul 13 15:24:48.072618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.072592    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:48.072745 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:48.072696    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr97l" podUID="90c1d775-ac5d-4ded-9ba5-938aaa280e26"
Jul 13 15:24:48.072745 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.072734    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:48.072861 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:24:48.072810    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45g28" podUID="4972f3e0-9154-4893-bd4a-f516b1ce678b"
Jul 13 15:24:48.220028 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.220003    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeReady"
Jul 13 15:24:48.220396 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.220114    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 15:24:48.291807 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.291780    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lsq6q"]
Jul 13 15:24:48.323509 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.323436    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9q9dk"]
Jul 13 15:24:48.323654 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.323557    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.327785 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.327764    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 15:24:48.328006 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.327990    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8x6l\""
Jul 13 15:24:48.328079 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.327989    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 15:24:48.337338 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.337323    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dtm7d"]
Jul 13 15:24:48.337464 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.337449    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.337534 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.337520    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 15:24:48.340199 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.340180    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlhs\""
Jul 13 15:24:48.341623 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.341608    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 15:24:48.342203 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.342186    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 15:24:48.353576 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.353559    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lsq6q"]
Jul 13 15:24:48.353673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.353589    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9q9dk"]
Jul 13 15:24:48.353673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.353646    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dtm7d"]
Jul 13 15:24:48.353764 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.353733    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.356307 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.356286    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 15:24:48.360917 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.360900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b4e7dc8-d490-4408-8c9d-dd85d869068d-data-volume\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.361019 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.360923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vphvj\" (UniqueName: \"kubernetes.io/projected/0b4e7dc8-d490-4408-8c9d-dd85d869068d-kube-api-access-vphvj\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.361019 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.360943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b4e7dc8-d490-4408-8c9d-dd85d869068d-crio-socket\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.361019 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.360959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-metrics-tls\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.361019 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.361010    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft4js\" (UniqueName: \"kubernetes.io/projected/8d9015e0-b14d-489e-af21-227eccccc129-kube-api-access-ft4js\") pod \"ingress-canary-lsq6q\" (UID: \"8d9015e0-b14d-489e-af21-227eccccc129\") " pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.361186 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.361056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4e7dc8-d490-4408-8c9d-dd85d869068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.361186 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.361111    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d9015e0-b14d-489e-af21-227eccccc129-cert\") pod \"ingress-canary-lsq6q\" (UID: \"8d9015e0-b14d-489e-af21-227eccccc129\") " pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.361186 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.361142    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-tmp-dir\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.361186 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.361160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-config-volume\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.361353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.361209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4vm\" (UniqueName: \"kubernetes.io/projected/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-kube-api-access-jz4vm\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.361353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.361225    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4e7dc8-d490-4408-8c9d-dd85d869068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.362445 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.362428    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 15:24:48.362497 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.362451    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 15:24:48.362574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.362557    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 15:24:48.362861 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.362848    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-74ppt\""
Jul 13 15:24:48.462071 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b4e7dc8-d490-4408-8c9d-dd85d869068d-data-volume\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.462071 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462074    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vphvj\" (UniqueName: \"kubernetes.io/projected/0b4e7dc8-d490-4408-8c9d-dd85d869068d-kube-api-access-vphvj\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462105    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b4e7dc8-d490-4408-8c9d-dd85d869068d-crio-socket\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-metrics-tls\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462161    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft4js\" (UniqueName: \"kubernetes.io/projected/8d9015e0-b14d-489e-af21-227eccccc129-kube-api-access-ft4js\") pod \"ingress-canary-lsq6q\" (UID: \"8d9015e0-b14d-489e-af21-227eccccc129\") " pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462187    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4e7dc8-d490-4408-8c9d-dd85d869068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462213    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d9015e0-b14d-489e-af21-227eccccc129-cert\") pod \"ingress-canary-lsq6q\" (UID: \"8d9015e0-b14d-489e-af21-227eccccc129\") " pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462283    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-tmp-dir\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462311    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-config-volume\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462350    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4vm\" (UniqueName: \"kubernetes.io/projected/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-kube-api-access-jz4vm\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4e7dc8-d490-4408-8c9d-dd85d869068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462377    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0b4e7dc8-d490-4408-8c9d-dd85d869068d-crio-socket\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.462622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462452    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b4e7dc8-d490-4408-8c9d-dd85d869068d-data-volume\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.463042 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462790    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-tmp-dir\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.463042 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.462881    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0b4e7dc8-d490-4408-8c9d-dd85d869068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.463107 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.463063    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-config-volume\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.466373 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.466351    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-metrics-tls\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.466473 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.466354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0b4e7dc8-d490-4408-8c9d-dd85d869068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.466534 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.466517    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d9015e0-b14d-489e-af21-227eccccc129-cert\") pod \"ingress-canary-lsq6q\" (UID: \"8d9015e0-b14d-489e-af21-227eccccc129\") " pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.473571 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.473550    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4vm\" (UniqueName: \"kubernetes.io/projected/e87b809b-2b9d-41b3-b82d-cd4c65e79d31-kube-api-access-jz4vm\") pod \"dns-default-9q9dk\" (UID: \"e87b809b-2b9d-41b3-b82d-cd4c65e79d31\") " pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.473695 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.473632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft4js\" (UniqueName: \"kubernetes.io/projected/8d9015e0-b14d-489e-af21-227eccccc129-kube-api-access-ft4js\") pod \"ingress-canary-lsq6q\" (UID: \"8d9015e0-b14d-489e-af21-227eccccc129\") " pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.473784 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.473768    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vphvj\" (UniqueName: \"kubernetes.io/projected/0b4e7dc8-d490-4408-8c9d-dd85d869068d-kube-api-access-vphvj\") pod \"insights-runtime-extractor-dtm7d\" (UID: \"0b4e7dc8-d490-4408-8c9d-dd85d869068d\") " pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.632850 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.632769    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lsq6q"
Jul 13 15:24:48.644942 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.644924    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:48.662067 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.662029    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dtm7d"
Jul 13 15:24:48.838394 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.838353    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9q9dk"]
Jul 13 15:24:48.841375 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:48.841112    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87b809b_2b9d_41b3_b82d_cd4c65e79d31.slice/crio-1d4811787678520623a7434a890078724b8ad1769cd7a82de8e6bba68cfda328 WatchSource:0}: Error finding container 1d4811787678520623a7434a890078724b8ad1769cd7a82de8e6bba68cfda328: Status 404 returned error can't find the container with id 1d4811787678520623a7434a890078724b8ad1769cd7a82de8e6bba68cfda328
Jul 13 15:24:48.841809 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.841745    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lsq6q"]
Jul 13 15:24:48.846609 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:48.846571    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9015e0_b14d_489e_af21_227eccccc129.slice/crio-a33df455fd6474fa3561c12751eb7d8fd9432437dad85d3c3573a062c88a15fd WatchSource:0}: Error finding container a33df455fd6474fa3561c12751eb7d8fd9432437dad85d3c3573a062c88a15fd: Status 404 returned error can't find the container with id a33df455fd6474fa3561c12751eb7d8fd9432437dad85d3c3573a062c88a15fd
Jul 13 15:24:48.853318 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:48.853200    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dtm7d"]
Jul 13 15:24:48.856190 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:48.856168    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4e7dc8_d490_4408_8c9d_dd85d869068d.slice/crio-b9a19e5874558d576a4dbf5355e189aa9d6842830252576660c7fe2c822997c0 WatchSource:0}: Error finding container b9a19e5874558d576a4dbf5355e189aa9d6842830252576660c7fe2c822997c0: Status 404 returned error can't find the container with id b9a19e5874558d576a4dbf5355e189aa9d6842830252576660c7fe2c822997c0
Jul 13 15:24:49.073432 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:49.073401    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:24:49.078338 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:49.078312    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hbtnc\""
Jul 13 15:24:49.078490 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:49.078311    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 15:24:49.256872 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:49.256842    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtm7d" event={"ID":"0b4e7dc8-d490-4408-8c9d-dd85d869068d","Type":"ContainerStarted","Data":"b9a19e5874558d576a4dbf5355e189aa9d6842830252576660c7fe2c822997c0"}
Jul 13 15:24:49.257990 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:49.257967    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9q9dk" event={"ID":"e87b809b-2b9d-41b3-b82d-cd4c65e79d31","Type":"ContainerStarted","Data":"1d4811787678520623a7434a890078724b8ad1769cd7a82de8e6bba68cfda328"}
Jul 13 15:24:49.258987 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:49.258967    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lsq6q" event={"ID":"8d9015e0-b14d-489e-af21-227eccccc129","Type":"ContainerStarted","Data":"a33df455fd6474fa3561c12751eb7d8fd9432437dad85d3c3573a062c88a15fd"}
Jul 13 15:24:50.073110 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:50.073075    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:24:50.073383 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:50.073348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:24:50.076484 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:50.076460    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 15:24:50.078575 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:50.078551    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 15:24:50.078832 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:50.078813    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-489nl\""
Jul 13 15:24:50.079099 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:50.079054    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 15:24:54.412574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.412538    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-49wn9"]
Jul 13 15:24:54.459800 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.459765    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-49wn9"]
Jul 13 15:24:54.459946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.459884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-49wn9"
Jul 13 15:24:54.462579 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.462561    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 15:24:54.464372 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.464357    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 15:24:54.464433 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.464360    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-468fn\""
Jul 13 15:24:54.505986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.505957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7crhr\" (UniqueName: \"kubernetes.io/projected/30761bef-a21f-4198-a036-815adf3134ed-kube-api-access-7crhr\") pod \"downloads-68c9cbb497-49wn9\" (UID: \"30761bef-a21f-4198-a036-815adf3134ed\") " pod="openshift-console/downloads-68c9cbb497-49wn9"
Jul 13 15:24:54.606382 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.606349    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7crhr\" (UniqueName: \"kubernetes.io/projected/30761bef-a21f-4198-a036-815adf3134ed-kube-api-access-7crhr\") pod \"downloads-68c9cbb497-49wn9\" (UID: \"30761bef-a21f-4198-a036-815adf3134ed\") " pod="openshift-console/downloads-68c9cbb497-49wn9"
Jul 13 15:24:54.616811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.616785    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7crhr\" (UniqueName: \"kubernetes.io/projected/30761bef-a21f-4198-a036-815adf3134ed-kube-api-access-7crhr\") pod \"downloads-68c9cbb497-49wn9\" (UID: \"30761bef-a21f-4198-a036-815adf3134ed\") " pod="openshift-console/downloads-68c9cbb497-49wn9"
Jul 13 15:24:54.769153 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:54.769070    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-49wn9"
Jul 13 15:24:55.278949 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:55.278923    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9q9dk" event={"ID":"e87b809b-2b9d-41b3-b82d-cd4c65e79d31","Type":"ContainerStarted","Data":"37ef4313a511c9cce1ee8c0980caacf2e5e4c051f3ff7b7fa6853f1d61098075"}
Jul 13 15:24:55.280417 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:55.280398    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-49wn9"]
Jul 13 15:24:55.286354 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:55.286290    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30761bef_a21f_4198_a036_815adf3134ed.slice/crio-ac88a2c49a858b89ec354506ebb0a43ddaf056c32711a9827743fd475f603608 WatchSource:0}: Error finding container ac88a2c49a858b89ec354506ebb0a43ddaf056c32711a9827743fd475f603608: Status 404 returned error can't find the container with id ac88a2c49a858b89ec354506ebb0a43ddaf056c32711a9827743fd475f603608
Jul 13 15:24:56.283935 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.283856    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtm7d" event={"ID":"0b4e7dc8-d490-4408-8c9d-dd85d869068d","Type":"ContainerStarted","Data":"b6b97457e40c61dbaeea5cb866c6388074496f7668fb597ba4d1770d052b12ad"}
Jul 13 15:24:56.283935 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.283916    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtm7d" event={"ID":"0b4e7dc8-d490-4408-8c9d-dd85d869068d","Type":"ContainerStarted","Data":"4007f9dd03af0864342140c2caf8dbfb6ef43abb9e14546d734c9c77c4f5da32"}
Jul 13 15:24:56.285525 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.285499    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9q9dk" event={"ID":"e87b809b-2b9d-41b3-b82d-cd4c65e79d31","Type":"ContainerStarted","Data":"dfe1455a91dcb4502246a6617471f0560b0041e3c22d5b8b15f4bc64de1ab401"}
Jul 13 15:24:56.285659 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.285614    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:24:56.286662 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.286634    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-49wn9" event={"ID":"30761bef-a21f-4198-a036-815adf3134ed","Type":"ContainerStarted","Data":"ac88a2c49a858b89ec354506ebb0a43ddaf056c32711a9827743fd475f603608"}
Jul 13 15:24:56.287976 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.287957    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lsq6q" event={"ID":"8d9015e0-b14d-489e-af21-227eccccc129","Type":"ContainerStarted","Data":"a85dc9e95b76ce38f9d5222b4a6670d1b75af8be17c8a8b416a317f05ebc995d"}
Jul 13 15:24:56.306743 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.306696    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9q9dk" podStartSLOduration=2.006524403 podStartE2EDuration="8.306678818s" totalImagesPullingTime="6.300154415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:56.306172341 +0000 UTC m=+49.866862829" watchObservedRunningTime="2026-07-13 15:24:56.306678818 +0000 UTC m=+49.867369300"
Jul 13 15:24:56.323115 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:56.323077    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lsq6q" podStartSLOduration=2.022200845 podStartE2EDuration="8.323062008s" totalImagesPullingTime="6.300861163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:56.32235383 +0000 UTC m=+49.883044326" watchObservedRunningTime="2026-07-13 15:24:56.323062008 +0000 UTC m=+49.883752497"
Jul 13 15:24:58.231083 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.231048    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-rst8t"]
Jul 13 15:24:58.237158 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.237053    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.240168 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.239761    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 15:24:58.240168 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.240012    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jmn5s\""
Jul 13 15:24:58.240168 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.240028    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 13 15:24:58.240699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.240421    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 15:24:58.240699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.240549    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 13 15:24:58.240699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.240633    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 15:24:58.255243 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.255175    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-rst8t"]
Jul 13 15:24:58.337977 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.337939    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/64b95c0a-4439-47fe-ad87-2ce52c86988e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.338126 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.337986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b95c0a-4439-47fe-ad87-2ce52c86988e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.338126 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.338044    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64b95c0a-4439-47fe-ad87-2ce52c86988e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.338126 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.338096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mblf\" (UniqueName: \"kubernetes.io/projected/64b95c0a-4439-47fe-ad87-2ce52c86988e-kube-api-access-5mblf\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.438788 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.438750    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/64b95c0a-4439-47fe-ad87-2ce52c86988e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.438788 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.438794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b95c0a-4439-47fe-ad87-2ce52c86988e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.439049 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.438840    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64b95c0a-4439-47fe-ad87-2ce52c86988e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.439049 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.438875    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mblf\" (UniqueName: \"kubernetes.io/projected/64b95c0a-4439-47fe-ad87-2ce52c86988e-kube-api-access-5mblf\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.439673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.439632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b95c0a-4439-47fe-ad87-2ce52c86988e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.441524 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.441504    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64b95c0a-4439-47fe-ad87-2ce52c86988e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.441647 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.441627    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/64b95c0a-4439-47fe-ad87-2ce52c86988e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.448138 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.448110    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mblf\" (UniqueName: \"kubernetes.io/projected/64b95c0a-4439-47fe-ad87-2ce52c86988e-kube-api-access-5mblf\") pod \"prometheus-operator-64785b6675-rst8t\" (UID: \"64b95c0a-4439-47fe-ad87-2ce52c86988e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.550571 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.550493    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t"
Jul 13 15:24:58.896844 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:58.896816    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-rst8t"]
Jul 13 15:24:58.900089 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:24:58.900058    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b95c0a_4439_47fe_ad87_2ce52c86988e.slice/crio-90fb7f2ade5bbc269d6b3387e80ab131ca6bf5e57d3cd8cf42a80c73bf7a1be4 WatchSource:0}: Error finding container 90fb7f2ade5bbc269d6b3387e80ab131ca6bf5e57d3cd8cf42a80c73bf7a1be4: Status 404 returned error can't find the container with id 90fb7f2ade5bbc269d6b3387e80ab131ca6bf5e57d3cd8cf42a80c73bf7a1be4
Jul 13 15:24:59.300969 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.300924    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t" event={"ID":"64b95c0a-4439-47fe-ad87-2ce52c86988e","Type":"ContainerStarted","Data":"90fb7f2ade5bbc269d6b3387e80ab131ca6bf5e57d3cd8cf42a80c73bf7a1be4"}
Jul 13 15:24:59.303190 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.303154    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtm7d" event={"ID":"0b4e7dc8-d490-4408-8c9d-dd85d869068d","Type":"ContainerStarted","Data":"a7a7cfed7148a67a5fe733809077a40bb098b0fc199b29f0f6b12b550fd4b46e"}
Jul 13 15:24:59.323407 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.323358    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dtm7d" podStartSLOduration=1.5167811439999999 podStartE2EDuration="11.323339573s" totalImagesPullingTime="9.806558429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:59.322715925 +0000 UTC m=+52.883406414" watchObservedRunningTime="2026-07-13 15:24:59.323339573 +0000 UTC m=+52.884030061"
Jul 13 15:24:59.726346 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.726314    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5447bfbdb7-bvhlt"]
Jul 13 15:24:59.728366 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.728350    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.731220 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.731194    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 15:24:59.731486 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.731457    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 15:24:59.731610 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.731503    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 15:24:59.732342 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.732323    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mgdfp\""
Jul 13 15:24:59.732440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.732361    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 15:24:59.732440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.732363    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 15:24:59.739603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.739581    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5447bfbdb7-bvhlt"]
Jul 13 15:24:59.750753 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.750733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-oauth-config\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.750856 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.750764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-serving-cert\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.750856 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.750814    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-oauth-serving-cert\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.750947 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.750864    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-service-ca\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.750947 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.750909    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl65d\" (UniqueName: \"kubernetes.io/projected/7207ae90-3106-485c-8934-c5e2572e59d8-kube-api-access-dl65d\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.750947 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.750931    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-console-config\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.852141 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.852107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl65d\" (UniqueName: \"kubernetes.io/projected/7207ae90-3106-485c-8934-c5e2572e59d8-kube-api-access-dl65d\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.852141 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.852144    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-console-config\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.852397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.852196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-oauth-config\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.852397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.852219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-serving-cert\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.852397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.852278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-oauth-serving-cert\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.852397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.852304    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-service-ca\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.853114 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.853083    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-console-config\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.853244 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.853228    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-service-ca\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.853394 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.853245    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-oauth-serving-cert\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.855119 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.855096    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-serving-cert\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.855234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.855140    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-oauth-config\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:24:59.861769 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:24:59.861745    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl65d\" (UniqueName: \"kubernetes.io/projected/7207ae90-3106-485c-8934-c5e2572e59d8-kube-api-access-dl65d\") pod \"console-5447bfbdb7-bvhlt\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") " pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:00.039002 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:00.038918    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:00.420033 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:00.420010    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5447bfbdb7-bvhlt"]
Jul 13 15:25:00.425521 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:00.425482    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7207ae90_3106_485c_8934_c5e2572e59d8.slice/crio-32912555cf0f54e41336e5aa89ebc75e428de34b4d7782a0533c8571251ee1fb WatchSource:0}: Error finding container 32912555cf0f54e41336e5aa89ebc75e428de34b4d7782a0533c8571251ee1fb: Status 404 returned error can't find the container with id 32912555cf0f54e41336e5aa89ebc75e428de34b4d7782a0533c8571251ee1fb
Jul 13 15:25:01.314077 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:01.314039    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t" event={"ID":"64b95c0a-4439-47fe-ad87-2ce52c86988e","Type":"ContainerStarted","Data":"8c1cd7c05c7a70745343c96fdc7a8799d06a78e84d4836d3cfb8c157908b1211"}
Jul 13 15:25:01.314282 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:01.314109    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t" event={"ID":"64b95c0a-4439-47fe-ad87-2ce52c86988e","Type":"ContainerStarted","Data":"3bd19efa80a7b3a9ba4186197fb437d62f4618ce604a4f8324c82e739ed525fc"}
Jul 13 15:25:01.316355 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:01.316324    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5447bfbdb7-bvhlt" event={"ID":"7207ae90-3106-485c-8934-c5e2572e59d8","Type":"ContainerStarted","Data":"32912555cf0f54e41336e5aa89ebc75e428de34b4d7782a0533c8571251ee1fb"}
Jul 13 15:25:01.337406 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:01.337197    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-rst8t" podStartSLOduration=1.934449184 podStartE2EDuration="3.337175196s" totalImagesPullingTime="1.402726012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:01.335756377 +0000 UTC m=+54.896446865" watchObservedRunningTime="2026-07-13 15:25:01.337175196 +0000 UTC m=+54.897865684"
Jul 13 15:25:03.636636 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.636602    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"]
Jul 13 15:25:03.643213 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.643185    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.646665 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.646201    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zr8z8\""
Jul 13 15:25:03.646665 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.646385    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 13 15:25:03.646665 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.646485    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 13 15:25:03.657899 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.657870    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"]
Jul 13 15:25:03.674037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.674015    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7lks6"]
Jul 13 15:25:03.676548 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.676523    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.680206 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.680073    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20b46f8c-d703-4b0f-ab83-724f6b621b48-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.680206 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.680123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20b46f8c-d703-4b0f-ab83-724f6b621b48-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.680206 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.680156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20b46f8c-d703-4b0f-ab83-724f6b621b48-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.680432 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.680294    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfzs\" (UniqueName: \"kubernetes.io/projected/20b46f8c-d703-4b0f-ab83-724f6b621b48-kube-api-access-8xfzs\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.680552 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.680533    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 15:25:03.680632 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.680614    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hjgnp\""
Jul 13 15:25:03.680711 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.680694    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 15:25:03.682671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.682622    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 15:25:03.781161 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781119    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20b46f8c-d703-4b0f-ab83-724f6b621b48-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.781372 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781188    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20b46f8c-d703-4b0f-ab83-724f6b621b48-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.781372 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781226    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f3ad46-fac0-4c29-ac88-c57aa55765da-metrics-client-ca\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781372 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781372 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781339    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781372 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-tls\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781399    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwtq\" (UniqueName: \"kubernetes.io/projected/58f3ad46-fac0-4c29-ac88-c57aa55765da-kube-api-access-rkwtq\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20b46f8c-d703-4b0f-ab83-724f6b621b48-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.781699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781535    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-sys\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781582    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-wtmp\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfzs\" (UniqueName: \"kubernetes.io/projected/20b46f8c-d703-4b0f-ab83-724f6b621b48-kube-api-access-8xfzs\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.781699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781628    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-root\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.781699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-textfile\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.782045 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.781926    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20b46f8c-d703-4b0f-ab83-724f6b621b48-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.784631 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.784602    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20b46f8c-d703-4b0f-ab83-724f6b621b48-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.784765 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.784632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/20b46f8c-d703-4b0f-ab83-724f6b621b48-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.789820 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.789788    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xfzs\" (UniqueName: \"kubernetes.io/projected/20b46f8c-d703-4b0f-ab83-724f6b621b48-kube-api-access-8xfzs\") pod \"openshift-state-metrics-84bd68b896-hpbtz\" (UID: \"20b46f8c-d703-4b0f-ab83-724f6b621b48\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:03.882109 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-sys\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882109 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-wtmp\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882143    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-root\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882168    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-textfile\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882167    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-sys\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882245    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f3ad46-fac0-4c29-ac88-c57aa55765da-metrics-client-ca\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882292    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882296    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-wtmp\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882360    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-tls\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882361    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58f3ad46-fac0-4c29-ac88-c57aa55765da-root\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882394    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwtq\" (UniqueName: \"kubernetes.io/projected/58f3ad46-fac0-4c29-ac88-c57aa55765da-kube-api-access-rkwtq\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882522    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-textfile\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.882864 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:25:03.882710    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 15:25:03.882864 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:25:03.882787    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-tls podName:58f3ad46-fac0-4c29-ac88-c57aa55765da nodeName:}" failed. No retries permitted until 2026-07-13 15:25:04.382766503 +0000 UTC m=+57.943456972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-tls") pod "node-exporter-7lks6" (UID: "58f3ad46-fac0-4c29-ac88-c57aa55765da") : secret "node-exporter-tls" not found
Jul 13 15:25:03.882971 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.882910    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.883143 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.883121    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f3ad46-fac0-4c29-ac88-c57aa55765da-metrics-client-ca\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.885049 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.885024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.894973 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.894900    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwtq\" (UniqueName: \"kubernetes.io/projected/58f3ad46-fac0-4c29-ac88-c57aa55765da-kube-api-access-rkwtq\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:03.956395 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:03.956362    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"
Jul 13 15:25:04.135114 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.135079    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz"]
Jul 13 15:25:04.138702 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:04.138677    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b46f8c_d703_4b0f_ab83_724f6b621b48.slice/crio-2cb3bf06724d0dbbaad308c22f1a545c5200cbf529d13e7547e391bd49499f85 WatchSource:0}: Error finding container 2cb3bf06724d0dbbaad308c22f1a545c5200cbf529d13e7547e391bd49499f85: Status 404 returned error can't find the container with id 2cb3bf06724d0dbbaad308c22f1a545c5200cbf529d13e7547e391bd49499f85
Jul 13 15:25:04.330394 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.330119    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5447bfbdb7-bvhlt" event={"ID":"7207ae90-3106-485c-8934-c5e2572e59d8","Type":"ContainerStarted","Data":"c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23"}
Jul 13 15:25:04.332467 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.332436    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz" event={"ID":"20b46f8c-d703-4b0f-ab83-724f6b621b48","Type":"ContainerStarted","Data":"923ee7e0a42ab8ee90da91940c6714fe3ca333d848ba1ea55982746273b323b2"}
Jul 13 15:25:04.332599 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.332500    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz" event={"ID":"20b46f8c-d703-4b0f-ab83-724f6b621b48","Type":"ContainerStarted","Data":"54f0d85db4b4cab6eb69cdff24b34714f9cad3a905add1973ca1787874f758ca"}
Jul 13 15:25:04.332599 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.332530    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz" event={"ID":"20b46f8c-d703-4b0f-ab83-724f6b621b48","Type":"ContainerStarted","Data":"2cb3bf06724d0dbbaad308c22f1a545c5200cbf529d13e7547e391bd49499f85"}
Jul 13 15:25:04.372930 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.372872    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5447bfbdb7-bvhlt" podStartSLOduration=1.82449514 podStartE2EDuration="5.372851988s" totalImagesPullingTime="3.548356848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:04.372048529 +0000 UTC m=+57.932739015" watchObservedRunningTime="2026-07-13 15:25:04.372851988 +0000 UTC m=+57.933542456"
Jul 13 15:25:04.387161 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.387130    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-tls\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:04.389763 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.389739    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58f3ad46-fac0-4c29-ac88-c57aa55765da-node-exporter-tls\") pod \"node-exporter-7lks6\" (UID: \"58f3ad46-fac0-4c29-ac88-c57aa55765da\") " pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:04.588447 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:04.588361    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lks6"
Jul 13 15:25:04.598449 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:04.598419    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f3ad46_fac0_4c29_ac88_c57aa55765da.slice/crio-e4f7e91d943f48b4eef0af88f5b195cb1ccf8fce0ad561e3a59e0247f1f1a802 WatchSource:0}: Error finding container e4f7e91d943f48b4eef0af88f5b195cb1ccf8fce0ad561e3a59e0247f1f1a802: Status 404 returned error can't find the container with id e4f7e91d943f48b4eef0af88f5b195cb1ccf8fce0ad561e3a59e0247f1f1a802
Jul 13 15:25:05.339558 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:05.339516    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lks6" event={"ID":"58f3ad46-fac0-4c29-ac88-c57aa55765da","Type":"ContainerStarted","Data":"e4f7e91d943f48b4eef0af88f5b195cb1ccf8fce0ad561e3a59e0247f1f1a802"}
Jul 13 15:25:06.295193 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.295151    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9q9dk"
Jul 13 15:25:06.346966 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.346931    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz" event={"ID":"20b46f8c-d703-4b0f-ab83-724f6b621b48","Type":"ContainerStarted","Data":"ebd3d2a255ce170e28ec0a6b19be2a5ddd2291e1aeb50c2e271387f435e8a9e3"}
Jul 13 15:25:06.348689 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.348658    2556 generic.go:356] "Generic (PLEG): container finished" podID="58f3ad46-fac0-4c29-ac88-c57aa55765da" containerID="1d18bea7a826b42a7d620d4ff6c4ced8990077813a871536e21de507f289a263" exitCode=0
Jul 13 15:25:06.348817 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.348705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lks6" event={"ID":"58f3ad46-fac0-4c29-ac88-c57aa55765da","Type":"ContainerDied","Data":"1d18bea7a826b42a7d620d4ff6c4ced8990077813a871536e21de507f289a263"}
Jul 13 15:25:06.377132 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.377079    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-hpbtz" podStartSLOduration=2.049255631 podStartE2EDuration="3.377058562s" totalImagesPullingTime="1.327802931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:06.376311468 +0000 UTC m=+59.937001956" watchObservedRunningTime="2026-07-13 15:25:06.377058562 +0000 UTC m=+59.937749053"
Jul 13 15:25:06.780517 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.780480    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75595697f4-spj6x"]
Jul 13 15:25:06.811692 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.811654    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75595697f4-spj6x"]
Jul 13 15:25:06.811872 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.811793    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.815471 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.815446    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 13 15:25:06.815809 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.815783    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 13 15:25:06.816832 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.816810    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 13 15:25:06.816933 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.816869    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-x6f2d\""
Jul 13 15:25:06.817157 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.817085    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 13 15:25:06.817157 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.817117    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 13 15:25:06.817369 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.817212    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-avr30qqpa6e9\""
Jul 13 15:25:06.911183 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-grpc-tls\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.911373 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911192    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t499h\" (UniqueName: \"kubernetes.io/projected/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-kube-api-access-t499h\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.911373 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911223    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.911373 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-metrics-client-ca\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.911538 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.911538 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911446    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-tls\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.911538 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911476    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:06.911538 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:06.911509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.011884 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.011847    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.012045 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.011906    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-tls\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.012045 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.011939    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.012045 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.011968    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.012045 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.012030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-grpc-tls\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.012349 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.012068    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t499h\" (UniqueName: \"kubernetes.io/projected/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-kube-api-access-t499h\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.012349 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.012102    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.012349 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.012152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-metrics-client-ca\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.013217 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.013189    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-metrics-client-ca\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.015618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.015573    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.015722 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.015674    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.015795 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.015739    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-grpc-tls\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.015795 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.015765    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.015903 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.015791    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.016009 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.015987    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-secret-thanos-querier-tls\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.023429 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.023406    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t499h\" (UniqueName: \"kubernetes.io/projected/f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6-kube-api-access-t499h\") pod \"thanos-querier-75595697f4-spj6x\" (UID: \"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6\") " pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:07.123825 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:07.123745    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:08.000425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.000387    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"]
Jul 13 15:25:08.003445 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.003422    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.005930 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.005909    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 13 15:25:08.006051 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.006000    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2quq6nqansqkp\""
Jul 13 15:25:08.006801 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.006780    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 15:25:08.006898 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.006813    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 13 15:25:08.006898 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.006890    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 13 15:25:08.007079 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.007064    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fpmmm\""
Jul 13 15:25:08.016036 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.016018    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"]
Jul 13 15:25:08.121976 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.121943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-secret-metrics-server-client-certs\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.121976 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.121977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a481658-34a7-4618-aba6-f31282dbd8d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.122197 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.121998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-client-ca-bundle\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.122197 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.122031    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0a481658-34a7-4618-aba6-f31282dbd8d4-audit-log\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.122197 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.122059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0a481658-34a7-4618-aba6-f31282dbd8d4-metrics-server-audit-profiles\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.122197 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.122106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75z8c\" (UniqueName: \"kubernetes.io/projected/0a481658-34a7-4618-aba6-f31282dbd8d4-kube-api-access-75z8c\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.122197 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.122152    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-secret-metrics-server-tls\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.223374 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.223328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75z8c\" (UniqueName: \"kubernetes.io/projected/0a481658-34a7-4618-aba6-f31282dbd8d4-kube-api-access-75z8c\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.223536 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.223406    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-secret-metrics-server-tls\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.223536 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.223456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-secret-metrics-server-client-certs\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.223536 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.223479    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a481658-34a7-4618-aba6-f31282dbd8d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.223728 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.223686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-client-ca-bundle\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.223862 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.223764    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0a481658-34a7-4618-aba6-f31282dbd8d4-audit-log\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.223862 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.223796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0a481658-34a7-4618-aba6-f31282dbd8d4-metrics-server-audit-profiles\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.224233 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.224171    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0a481658-34a7-4618-aba6-f31282dbd8d4-audit-log\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.224358 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.224258    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a481658-34a7-4618-aba6-f31282dbd8d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.224733 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.224705    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0a481658-34a7-4618-aba6-f31282dbd8d4-metrics-server-audit-profiles\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.226484 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.226465    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-secret-metrics-server-tls\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.226638 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.226620    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-secret-metrics-server-client-certs\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.227014 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.226993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a481658-34a7-4618-aba6-f31282dbd8d4-client-ca-bundle\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.233239 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.233213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75z8c\" (UniqueName: \"kubernetes.io/projected/0a481658-34a7-4618-aba6-f31282dbd8d4-kube-api-access-75z8c\") pod \"metrics-server-7c6cfddc96-vqkdm\" (UID: \"0a481658-34a7-4618-aba6-f31282dbd8d4\") " pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:08.235825 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.235805    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v745k"
Jul 13 15:25:08.314319 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:08.314211    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:10.039503 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.039467    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:10.039945 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.039540    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:10.045815 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.045766    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:10.076210 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.076173    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:25:10.080080 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.080056    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.083141 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.083007    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 15:25:10.083294 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.083163    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 15:25:10.083294 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.083223    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 15:25:10.083438 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.083323    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 15:25:10.083702 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.083686    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 15:25:10.084313 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.084294    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 15:25:10.084601 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.084514    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 15:25:10.086234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.084633    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 15:25:10.086234 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.085941    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dhs15q84ghk47\""
Jul 13 15:25:10.090685 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.089573    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 15:25:10.090685 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.089992    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 15:25:10.090685 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.090678    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 15:25:10.092331 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.091769    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 15:25:10.095141 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.093038    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-md52n\""
Jul 13 15:25:10.098490 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.098319    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 15:25:10.100369 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.100348    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 15:25:10.121174 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.121141    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:25:10.142226 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142191    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142398 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142398 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142398 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142398 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142420    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142443    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.142943 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143002 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143002 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.142992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-config\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143071 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143027    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143071 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143150 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143150 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143244 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27cqm\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-kube-api-access-27cqm\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143325 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143284    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.143527 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.143413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245076 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245300 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245300 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245126    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245300 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245151    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245300 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245300 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245214    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245300 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245321    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245402    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245426    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245457    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-config\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245492    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245515    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.245618 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245591    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246135 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27cqm\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-kube-api-access-27cqm\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246135 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245742    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246135 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245781    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246135 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245802    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246135 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.245831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246135 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.246126    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.246126    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.246881 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.246632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.248932 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.248618    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.249027 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.248980    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.249233 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.249210    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.249418 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.249396    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.249975 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.249947    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.250068 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.249951    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.250286 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.250242    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.250756 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.250733    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.250876 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.250854    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.252187 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.252107    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.252187 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.252162    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.252621 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.252308    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-config\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.252621 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.252330    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.252621 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.252447    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.253890 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.253848    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.254107 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.254062    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.261226 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.261186    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27cqm\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-kube-api-access-27cqm\") pod \"prometheus-k8s-0\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:10.368995 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.368889    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:10.396575 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:10.396539    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:12.671795 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.671760    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:25:12.672253 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.671834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:25:12.674816 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.674773    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 15:25:12.675074 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.675056    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 15:25:12.684802 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.684777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4972f3e0-9154-4893-bd4a-f516b1ce678b-original-pull-secret\") pod \"global-pull-secret-syncer-45g28\" (UID: \"4972f3e0-9154-4893-bd4a-f516b1ce678b\") " pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:25:12.684915 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.684893    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0533fed-e478-491d-9721-ce22dfb30bf5-metrics-certs\") pod \"network-metrics-daemon-vfdrs\" (UID: \"a0533fed-e478-491d-9721-ce22dfb30bf5\") " pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:25:12.773049 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.773011    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:25:12.775466 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.775440    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 15:25:12.785932 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.785913    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 15:25:12.787174 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.787136    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hbtnc\""
Jul 13 15:25:12.795231 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.795203    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfdrs"
Jul 13 15:25:12.796540 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.796519    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hwt\" (UniqueName: \"kubernetes.io/projected/90c1d775-ac5d-4ded-9ba5-938aaa280e26-kube-api-access-42hwt\") pod \"network-check-target-jr97l\" (UID: \"90c1d775-ac5d-4ded-9ba5-938aaa280e26\") " pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:25:12.900028 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.899998    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45g28"
Jul 13 15:25:12.902377 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.902357    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-489nl\""
Jul 13 15:25:12.911074 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:12.911049    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:25:13.745224 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:13.745194    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vfdrs"]
Jul 13 15:25:13.800742 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:13.800672    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0533fed_e478_491d_9721_ce22dfb30bf5.slice/crio-0e7bb98600bdc3f6f5e3bb8e02aea89bdc171839f842ec82645c1b077b1e80ec WatchSource:0}: Error finding container 0e7bb98600bdc3f6f5e3bb8e02aea89bdc171839f842ec82645c1b077b1e80ec: Status 404 returned error can't find the container with id 0e7bb98600bdc3f6f5e3bb8e02aea89bdc171839f842ec82645c1b077b1e80ec
Jul 13 15:25:13.809883 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:13.809794    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45g28"]
Jul 13 15:25:13.812251 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:13.812231    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4972f3e0_9154_4893_bd4a_f516b1ce678b.slice/crio-26e4bc37a32455d35fbb21b9d5e643d634ba03494e6345ca66da4779cefd303b WatchSource:0}: Error finding container 26e4bc37a32455d35fbb21b9d5e643d634ba03494e6345ca66da4779cefd303b: Status 404 returned error can't find the container with id 26e4bc37a32455d35fbb21b9d5e643d634ba03494e6345ca66da4779cefd303b
Jul 13 15:25:13.977104 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:13.977062    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jr97l"]
Jul 13 15:25:13.978639 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:13.978618    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"]
Jul 13 15:25:13.978915 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:13.978895    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a481658_34a7_4618_aba6_f31282dbd8d4.slice/crio-a0a0d266d8e0c401dd4b615c8bc2f80d567cf5d5e7ddf79c366f1fed97265a2f WatchSource:0}: Error finding container a0a0d266d8e0c401dd4b615c8bc2f80d567cf5d5e7ddf79c366f1fed97265a2f: Status 404 returned error can't find the container with id a0a0d266d8e0c401dd4b615c8bc2f80d567cf5d5e7ddf79c366f1fed97265a2f
Jul 13 15:25:13.985393 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:13.985372    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75595697f4-spj6x"]
Jul 13 15:25:13.989015 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:13.988995    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e72f6a_e1ab_498a_8d15_3c2c9189cfe6.slice/crio-d3a430c3fda5cf5c9205433ff14359e67a6d823c0ed529ccb22424dc91b28fd3 WatchSource:0}: Error finding container d3a430c3fda5cf5c9205433ff14359e67a6d823c0ed529ccb22424dc91b28fd3: Status 404 returned error can't find the container with id d3a430c3fda5cf5c9205433ff14359e67a6d823c0ed529ccb22424dc91b28fd3
Jul 13 15:25:13.994248 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:13.994224    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:25:13.996844 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:13.996824    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7f2985_2218_428a_9347_a1e52f6998fd.slice/crio-75cda0ac7c2f3d0b252d4244f43937af09a2acf527e4ca21509ca0a167be6faa WatchSource:0}: Error finding container 75cda0ac7c2f3d0b252d4244f43937af09a2acf527e4ca21509ca0a167be6faa: Status 404 returned error can't find the container with id 75cda0ac7c2f3d0b252d4244f43937af09a2acf527e4ca21509ca0a167be6faa
Jul 13 15:25:14.382033 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.381988    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-49wn9" event={"ID":"30761bef-a21f-4198-a036-815adf3134ed","Type":"ContainerStarted","Data":"20a9f8e18f67cd954dfd32eff46b77f3d7dcdbee2bb31a694a49abebae7d54c4"}
Jul 13 15:25:14.383182 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.383158    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-49wn9"
Jul 13 15:25:14.387127 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.387064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lks6" event={"ID":"58f3ad46-fac0-4c29-ac88-c57aa55765da","Type":"ContainerStarted","Data":"6a32bb4d09d2c0f4bc7a2f2e719dced5af5a8e82439a20553c417d23b11f08e8"}
Jul 13 15:25:14.387127 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.387121    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lks6" event={"ID":"58f3ad46-fac0-4c29-ac88-c57aa55765da","Type":"ContainerStarted","Data":"1d3d116441affa679d3217ad5b55fe7e56bd537f6fa62c5d66fa828c37124365"}
Jul 13 15:25:14.388774 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.388743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm" event={"ID":"0a481658-34a7-4618-aba6-f31282dbd8d4","Type":"ContainerStarted","Data":"a0a0d266d8e0c401dd4b615c8bc2f80d567cf5d5e7ddf79c366f1fed97265a2f"}
Jul 13 15:25:14.390772 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.390752    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45g28" event={"ID":"4972f3e0-9154-4893-bd4a-f516b1ce678b","Type":"ContainerStarted","Data":"26e4bc37a32455d35fbb21b9d5e643d634ba03494e6345ca66da4779cefd303b"}
Jul 13 15:25:14.392425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.392359    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-49wn9"
Jul 13 15:25:14.392812 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.392763    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vfdrs" event={"ID":"a0533fed-e478-491d-9721-ce22dfb30bf5","Type":"ContainerStarted","Data":"0e7bb98600bdc3f6f5e3bb8e02aea89bdc171839f842ec82645c1b077b1e80ec"}
Jul 13 15:25:14.394822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.394796    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" event={"ID":"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6","Type":"ContainerStarted","Data":"d3a430c3fda5cf5c9205433ff14359e67a6d823c0ed529ccb22424dc91b28fd3"}
Jul 13 15:25:14.396571 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.396546    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jr97l" event={"ID":"90c1d775-ac5d-4ded-9ba5-938aaa280e26","Type":"ContainerStarted","Data":"e89f87ad4c2767ba27ac78a2667c418b0994593b3d1f75b92226490f3fe0f1bd"}
Jul 13 15:25:14.399466 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.399438    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerStarted","Data":"75cda0ac7c2f3d0b252d4244f43937af09a2acf527e4ca21509ca0a167be6faa"}
Jul 13 15:25:14.412986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.412924    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-49wn9" podStartSLOduration=1.8197462469999999 podStartE2EDuration="20.412907037s" totalImagesPullingTime="18.59316079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:14.412088275 +0000 UTC m=+67.972778763" watchObservedRunningTime="2026-07-13 15:25:14.412907037 +0000 UTC m=+67.973597526"
Jul 13 15:25:14.445469 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:14.444379    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7lks6" podStartSLOduration=10.381953251 podStartE2EDuration="11.444355879s" totalImagesPullingTime="989.614848ms" totalInitContainerRuntime="72.78778ms" isStatefulPod=true podCreationTimestamp="2026-07-13 15:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:14.441679107 +0000 UTC m=+68.002369595" watchObservedRunningTime="2026-07-13 15:25:14.444355879 +0000 UTC m=+68.005046369"
Jul 13 15:25:19.100004 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.099966    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7589bd65-qfn4p"]
Jul 13 15:25:19.119995 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.119916    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7589bd65-qfn4p"]
Jul 13 15:25:19.120227 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.120042    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.131846 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.131423    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 15:25:19.243389 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.243346    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-trusted-ca-bundle\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.243584 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.243403    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-oauth-config\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.243584 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.243430    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-serving-cert\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.243584 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.243454    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5svbx\" (UniqueName: \"kubernetes.io/projected/803f8491-f2d7-4e67-b262-61baa2aac466-kube-api-access-5svbx\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.243584 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.243551    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-oauth-serving-cert\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.243796 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.243634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-service-ca\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.243796 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.243676    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-console-config\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.345179 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.345082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-oauth-serving-cert\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.345179 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.345148    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-service-ca\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.345440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.345185    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-console-config\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.345440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.345253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-trusted-ca-bundle\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.345440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.345295    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-oauth-config\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.345440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.345323    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-serving-cert\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.345440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.345348    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5svbx\" (UniqueName: \"kubernetes.io/projected/803f8491-f2d7-4e67-b262-61baa2aac466-kube-api-access-5svbx\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.346419 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.346390    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-oauth-serving-cert\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.347247 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.347219    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-service-ca\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.347852 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.347825    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-console-config\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.348517 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.348477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-trusted-ca-bundle\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.349456 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.349434    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-oauth-config\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.351659 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.351613    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-serving-cert\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.359835 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.359793    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5svbx\" (UniqueName: \"kubernetes.io/projected/803f8491-f2d7-4e67-b262-61baa2aac466-kube-api-access-5svbx\") pod \"console-7d7589bd65-qfn4p\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") " pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:19.433564 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:19.433531    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:22.765566 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:22.765473    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7589bd65-qfn4p"]
Jul 13 15:25:22.768848 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:25:22.768796    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803f8491_f2d7_4e67_b262_61baa2aac466.slice/crio-aa340b527d9c5b045fb63533e811105ece35668c122a8e9484079136b38314a1 WatchSource:0}: Error finding container aa340b527d9c5b045fb63533e811105ece35668c122a8e9484079136b38314a1: Status 404 returned error can't find the container with id aa340b527d9c5b045fb63533e811105ece35668c122a8e9484079136b38314a1
Jul 13 15:25:23.449986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.449947    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm" event={"ID":"0a481658-34a7-4618-aba6-f31282dbd8d4","Type":"ContainerStarted","Data":"dd9caa856cb12a8a6772e7658867df9b3bbcde2e0fc44c6f6c393dff2808ec65"}
Jul 13 15:25:23.451507 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.451477    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45g28" event={"ID":"4972f3e0-9154-4893-bd4a-f516b1ce678b","Type":"ContainerStarted","Data":"d3ad72c09c88c86777f6c5f4dc3cd02220a62ce632f20994e9c775a21347c6d9"}
Jul 13 15:25:23.453224 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.453192    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vfdrs" event={"ID":"a0533fed-e478-491d-9721-ce22dfb30bf5","Type":"ContainerStarted","Data":"bef162ceb507c1e31a2cba7f246ce2840f8c632cb221cf5eaaf830be8f8ccb0e"}
Jul 13 15:25:23.453344 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.453257    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vfdrs" event={"ID":"a0533fed-e478-491d-9721-ce22dfb30bf5","Type":"ContainerStarted","Data":"85f00cc315f0032b8728b9914079f9aaae0bcc42cd621cdc553051276c7341ea"}
Jul 13 15:25:23.455509 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.455484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" event={"ID":"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6","Type":"ContainerStarted","Data":"f451b1183a38af73e08cb26fcef8d9fd41d8b6bc7c7791983a8a90ed296e50ad"}
Jul 13 15:25:23.455626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.455539    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" event={"ID":"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6","Type":"ContainerStarted","Data":"f4aaba989493829ad9dee004eb5d7031db586493a85d1fb7fd41f9039cb76886"}
Jul 13 15:25:23.455626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.455565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" event={"ID":"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6","Type":"ContainerStarted","Data":"b6c9620b0d6e2b3420658e5ab6f9f13bb2e3b2227865fd3fd59e694ad0cde897"}
Jul 13 15:25:23.457021 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.456995    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jr97l" event={"ID":"90c1d775-ac5d-4ded-9ba5-938aaa280e26","Type":"ContainerStarted","Data":"312eb4f83e3be2d358d85ba6940eeec712528b2e53609fc518f7d754bcb62632"}
Jul 13 15:25:23.457127 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.457071    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:25:23.458481 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.458458    2556 generic.go:356] "Generic (PLEG): container finished" podID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerID="edbfebfb1f9b2c81234eceb5c96525ff85a8e9e717f4995119a0b8b3f1124f4b" exitCode=0
Jul 13 15:25:23.458587 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.458533    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"edbfebfb1f9b2c81234eceb5c96525ff85a8e9e717f4995119a0b8b3f1124f4b"}
Jul 13 15:25:23.460241 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.460150    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7589bd65-qfn4p" event={"ID":"803f8491-f2d7-4e67-b262-61baa2aac466","Type":"ContainerStarted","Data":"d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684"}
Jul 13 15:25:23.460241 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.460186    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7589bd65-qfn4p" event={"ID":"803f8491-f2d7-4e67-b262-61baa2aac466","Type":"ContainerStarted","Data":"aa340b527d9c5b045fb63533e811105ece35668c122a8e9484079136b38314a1"}
Jul 13 15:25:23.471281 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.471227    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm" podStartSLOduration=7.871894152 podStartE2EDuration="16.471215161s" totalImagesPullingTime="8.599321009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:23.470596712 +0000 UTC m=+77.031287203" watchObservedRunningTime="2026-07-13 15:25:23.471215161 +0000 UTC m=+77.031905642"
Jul 13 15:25:23.489322 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.489250    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jr97l" podStartSLOduration=67.836671102 podStartE2EDuration="1m16.489237105s" totalImagesPullingTime="8.652566003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:23.487343279 +0000 UTC m=+77.048033776" watchObservedRunningTime="2026-07-13 15:25:23.489237105 +0000 UTC m=+77.049927592"
Jul 13 15:25:23.507736 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.507697    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7589bd65-qfn4p" podStartSLOduration=4.507684313 podStartE2EDuration="4.507684313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:23.507096773 +0000 UTC m=+77.067787272" watchObservedRunningTime="2026-07-13 15:25:23.507684313 +0000 UTC m=+77.068374777"
Jul 13 15:25:23.524051 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.524014    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-45g28" podStartSLOduration=67.728586476 podStartE2EDuration="1m16.523998987s" totalImagesPullingTime="8.795412511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:23.523452292 +0000 UTC m=+77.084142780" watchObservedRunningTime="2026-07-13 15:25:23.523998987 +0000 UTC m=+77.084689474"
Jul 13 15:25:23.581804 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:23.581757    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vfdrs" podStartSLOduration=69.720023983 podStartE2EDuration="1m16.581743415s" totalImagesPullingTime="6.861719432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:23.581608155 +0000 UTC m=+77.142298634" watchObservedRunningTime="2026-07-13 15:25:23.581743415 +0000 UTC m=+77.142433901"
Jul 13 15:25:25.473744 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:25.473666    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" event={"ID":"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6","Type":"ContainerStarted","Data":"e5ecbb39ae527f5df52946f0ca18614b53ba88cabe88606d96f3c85dabe9df77"}
Jul 13 15:25:25.474231 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:25.473752    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" event={"ID":"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6","Type":"ContainerStarted","Data":"09789b4e9f9012fd22021c0346eaf906deb1285aff4667bd33a16b5ff8905c49"}
Jul 13 15:25:25.474231 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:25.473790    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" event={"ID":"f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6","Type":"ContainerStarted","Data":"c33f0cb7b137e9e4a827b475d413af243de8d1b8e4fd93a869336cc0694e116e"}
Jul 13 15:25:25.474231 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:25.473836    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:25.500218 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:25.500161    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x" podStartSLOduration=9.021387646 podStartE2EDuration="19.500143238s" totalImagesPullingTime="10.478755592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:25.498855236 +0000 UTC m=+79.059545723" watchObservedRunningTime="2026-07-13 15:25:25.500143238 +0000 UTC m=+79.060833734"
Jul 13 15:25:27.483913 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:27.483881    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerStarted","Data":"3c0f7fe8acca0a337b6961d7bea1c2d5efa701068daf2a54b689c08589b4a639"}
Jul 13 15:25:27.484253 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:27.483970    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerStarted","Data":"02e4d7a0cd2f96a695fa66d0648d054743548399409ce6db09374d6e2c0c5c5d"}
Jul 13 15:25:27.484253 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:27.483997    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerStarted","Data":"1ea1252a1e0810ee8dc19712c9e7c3eb2cf2cec07d6f47ffc54d6284b1930dcc"}
Jul 13 15:25:27.484253 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:27.484030    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerStarted","Data":"e03b428d574cd686cb6d6817b4a0b7d9c931c94a193b6570caf5e2d622901dd7"}
Jul 13 15:25:27.484253 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:27.484053    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerStarted","Data":"891e5dc35eb12d853a313a218d430eb11c192774cc5e16d48d539fa99fe10075"}
Jul 13 15:25:28.314936 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:28.314816    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:28.314936 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:28.314918    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:28.491460 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:28.491419    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerStarted","Data":"829753d0606b292c1072b2d45272fb229fe3a3cbb7ec2a30c6cac681aef82917"}
Jul 13 15:25:28.524722 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:28.524675    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.525811729 podStartE2EDuration="18.524658327s" totalImagesPullingTime="11.969920619s" totalInitContainerRuntime="28.925979ms" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:28.523045849 +0000 UTC m=+82.083736348" watchObservedRunningTime="2026-07-13 15:25:28.524658327 +0000 UTC m=+82.085348814"
Jul 13 15:25:29.434297 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:29.434248    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:29.434461 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:29.434314    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:29.439221 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:29.439197    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:29.499115 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:29.499090    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:25:29.555353 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:29.555319    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5447bfbdb7-bvhlt"]
Jul 13 15:25:30.397520 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:30.397488    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:25:31.486175 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:31.486146    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75595697f4-spj6x"
Jul 13 15:25:48.320453 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:48.320422    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:48.324306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:48.324287    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c6cfddc96-vqkdm"
Jul 13 15:25:54.468387 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.468355    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jr97l"
Jul 13 15:25:54.575501 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.575439    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5447bfbdb7-bvhlt" podUID="7207ae90-3106-485c-8934-c5e2572e59d8" containerName="console" containerID="cri-o://c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23" gracePeriod=15
Jul 13 15:25:54.872354 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.872319    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:54.954305 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.954245    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-service-ca\") pod \"7207ae90-3106-485c-8934-c5e2572e59d8\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") "
Jul 13 15:25:54.954480 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.954321    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-console-config\") pod \"7207ae90-3106-485c-8934-c5e2572e59d8\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") "
Jul 13 15:25:54.954480 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.954361    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl65d\" (UniqueName: \"kubernetes.io/projected/7207ae90-3106-485c-8934-c5e2572e59d8-kube-api-access-dl65d\") pod \"7207ae90-3106-485c-8934-c5e2572e59d8\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") "
Jul 13 15:25:54.954480 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.954422    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-oauth-serving-cert\") pod \"7207ae90-3106-485c-8934-c5e2572e59d8\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") "
Jul 13 15:25:54.954480 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.954474    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-oauth-config\") pod \"7207ae90-3106-485c-8934-c5e2572e59d8\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") "
Jul 13 15:25:54.954680 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.954500    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-serving-cert\") pod \"7207ae90-3106-485c-8934-c5e2572e59d8\" (UID: \"7207ae90-3106-485c-8934-c5e2572e59d8\") "
Jul 13 15:25:54.955128 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.955046    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7207ae90-3106-485c-8934-c5e2572e59d8" (UID: "7207ae90-3106-485c-8934-c5e2572e59d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:54.955128 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.955098    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "7207ae90-3106-485c-8934-c5e2572e59d8" (UID: "7207ae90-3106-485c-8934-c5e2572e59d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:54.955352 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.955139    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-console-config" (OuterVolumeSpecName: "console-config") pod "7207ae90-3106-485c-8934-c5e2572e59d8" (UID: "7207ae90-3106-485c-8934-c5e2572e59d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:54.957445 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.957419    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7207ae90-3106-485c-8934-c5e2572e59d8" (UID: "7207ae90-3106-485c-8934-c5e2572e59d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:25:54.957563 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.957474    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7207ae90-3106-485c-8934-c5e2572e59d8-kube-api-access-dl65d" (OuterVolumeSpecName: "kube-api-access-dl65d") pod "7207ae90-3106-485c-8934-c5e2572e59d8" (UID: "7207ae90-3106-485c-8934-c5e2572e59d8"). InnerVolumeSpecName "kube-api-access-dl65d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:25:54.957563 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:54.957552    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7207ae90-3106-485c-8934-c5e2572e59d8" (UID: "7207ae90-3106-485c-8934-c5e2572e59d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:25:55.056306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.056099    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-console-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:25:55.056306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.056139    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl65d\" (UniqueName: \"kubernetes.io/projected/7207ae90-3106-485c-8934-c5e2572e59d8-kube-api-access-dl65d\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:25:55.056306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.056157    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-oauth-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:25:55.056306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.056171    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-oauth-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:25:55.056306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.056187    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7207ae90-3106-485c-8934-c5e2572e59d8-console-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:25:55.056306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.056201    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7207ae90-3106-485c-8934-c5e2572e59d8-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:25:55.615837 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.615806    2556 generic.go:356] "Generic (PLEG): container finished" podID="7207ae90-3106-485c-8934-c5e2572e59d8" containerID="c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23" exitCode=0
Jul 13 15:25:55.616306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.615853    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5447bfbdb7-bvhlt"
Jul 13 15:25:55.616306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.615880    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5447bfbdb7-bvhlt" event={"ID":"7207ae90-3106-485c-8934-c5e2572e59d8","Type":"ContainerDied","Data":"c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23"}
Jul 13 15:25:55.616306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.615917    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5447bfbdb7-bvhlt" event={"ID":"7207ae90-3106-485c-8934-c5e2572e59d8","Type":"ContainerDied","Data":"32912555cf0f54e41336e5aa89ebc75e428de34b4d7782a0533c8571251ee1fb"}
Jul 13 15:25:55.616306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.615938    2556 scope.go:117] "RemoveContainer" containerID="c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23"
Jul 13 15:25:55.630506 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.630487    2556 scope.go:117] "RemoveContainer" containerID="c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23"
Jul 13 15:25:55.630739 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:25:55.630721    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23\": container with ID starting with c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23 not found: ID does not exist" containerID="c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23"
Jul 13 15:25:55.630799 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.630748    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23"} err="failed to get container status \"c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23\": rpc error: code = NotFound desc = could not find container \"c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23\": container with ID starting with c35562b7150251828dc8c0bd132ea07e7009d9c59ac15147c80f7b8daf0edc23 not found: ID does not exist"
Jul 13 15:25:55.637985 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.637948    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5447bfbdb7-bvhlt"]
Jul 13 15:25:55.644429 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:55.644410    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5447bfbdb7-bvhlt"]
Jul 13 15:25:57.081046 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:25:57.080992    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7207ae90-3106-485c-8934-c5e2572e59d8" path="/var/lib/kubelet/pods/7207ae90-3106-485c-8934-c5e2572e59d8/volumes"
Jul 13 15:26:10.397643 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:10.397596    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:10.451442 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:10.451417    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:10.688481 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:10.688457    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:28.579683 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.579651    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:26:28.580178 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.579934    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="prometheus" containerID="cri-o://891e5dc35eb12d853a313a218d430eb11c192774cc5e16d48d539fa99fe10075" gracePeriod=600
Jul 13 15:26:28.580178 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.579947    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy" containerID="cri-o://3c0f7fe8acca0a337b6961d7bea1c2d5efa701068daf2a54b689c08589b4a639" gracePeriod=600
Jul 13 15:26:28.580428 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.580374    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-web" containerID="cri-o://02e4d7a0cd2f96a695fa66d0648d054743548399409ce6db09374d6e2c0c5c5d" gracePeriod=600
Jul 13 15:26:28.581400 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.580748    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="config-reloader" containerID="cri-o://e03b428d574cd686cb6d6817b4a0b7d9c931c94a193b6570caf5e2d622901dd7" gracePeriod=600
Jul 13 15:26:28.581400 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.580905    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://829753d0606b292c1072b2d45272fb229fe3a3cbb7ec2a30c6cac681aef82917" gracePeriod=600
Jul 13 15:26:28.581400 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.579987    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="thanos-sidecar" containerID="cri-o://1ea1252a1e0810ee8dc19712c9e7c3eb2cf2cec07d6f47ffc54d6284b1930dcc" gracePeriod=600
Jul 13 15:26:28.742397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742367    2556 generic.go:356] "Generic (PLEG): container finished" podID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerID="829753d0606b292c1072b2d45272fb229fe3a3cbb7ec2a30c6cac681aef82917" exitCode=0
Jul 13 15:26:28.742397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742393    2556 generic.go:356] "Generic (PLEG): container finished" podID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerID="3c0f7fe8acca0a337b6961d7bea1c2d5efa701068daf2a54b689c08589b4a639" exitCode=0
Jul 13 15:26:28.742397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742404    2556 generic.go:356] "Generic (PLEG): container finished" podID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerID="02e4d7a0cd2f96a695fa66d0648d054743548399409ce6db09374d6e2c0c5c5d" exitCode=0
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742414    2556 generic.go:356] "Generic (PLEG): container finished" podID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerID="1ea1252a1e0810ee8dc19712c9e7c3eb2cf2cec07d6f47ffc54d6284b1930dcc" exitCode=0
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742420    2556 generic.go:356] "Generic (PLEG): container finished" podID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerID="e03b428d574cd686cb6d6817b4a0b7d9c931c94a193b6570caf5e2d622901dd7" exitCode=0
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742426    2556 generic.go:356] "Generic (PLEG): container finished" podID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerID="891e5dc35eb12d853a313a218d430eb11c192774cc5e16d48d539fa99fe10075" exitCode=0
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742437    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"829753d0606b292c1072b2d45272fb229fe3a3cbb7ec2a30c6cac681aef82917"}
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742527    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"3c0f7fe8acca0a337b6961d7bea1c2d5efa701068daf2a54b689c08589b4a639"}
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742554    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"02e4d7a0cd2f96a695fa66d0648d054743548399409ce6db09374d6e2c0c5c5d"}
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742581    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"1ea1252a1e0810ee8dc19712c9e7c3eb2cf2cec07d6f47ffc54d6284b1930dcc"}
Jul 13 15:26:28.742603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"e03b428d574cd686cb6d6817b4a0b7d9c931c94a193b6570caf5e2d622901dd7"}
Jul 13 15:26:28.742829 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.742626    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"891e5dc35eb12d853a313a218d430eb11c192774cc5e16d48d539fa99fe10075"}
Jul 13 15:26:28.845811 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.845786    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:28.925455 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925427    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-1\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925642 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925464    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-thanos-prometheus-http-client-file\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925642 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925494    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-grpc-tls\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925642 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925522    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-tls\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925802 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925720    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-trusted-ca-bundle\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925802 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925765    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-0\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925802 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925793    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-web-config\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925955 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:28.925955 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925823    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-metrics-client-ca\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925955 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925849    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-db\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925955 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925884    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-2\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925955 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925909    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-config\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.925955 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925956    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-config-out\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.925983    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-tls-assets\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926011    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-serving-certs-ca-bundle\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926050    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-metrics-client-certs\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926082    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926077    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926107    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-kubelet-serving-ca-bundle\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926174    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-kube-rbac-proxy\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926197    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:28.926242 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926216    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27cqm\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-kube-api-access-27cqm\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926710 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926251    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"eb7f2985-2218-428a-9347-a1e52f6998fd\" (UID: \"eb7f2985-2218-428a-9347-a1e52f6998fd\") "
Jul 13 15:26:28.926710 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926530    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:28.926710 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926551    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:28.926710 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926568    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-metrics-client-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:28.926985 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.926954    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:28.927206 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.927178    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:28.927962 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.927669    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:28.928062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.927989    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:26:28.929201 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.929163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:28.930413 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.930383    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.930960 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.930928    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-config-out" (OuterVolumeSpecName: "config-out") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:26:28.931052 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.931032    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.931473 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.931096    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.931473 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.931420    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.931692 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.931658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:26:28.931762 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.931734    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.931873 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.931835    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.931946 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.931926    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-config" (OuterVolumeSpecName: "config") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.932037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.932012    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:28.932092 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.932063    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-kube-api-access-27cqm" (OuterVolumeSpecName: "kube-api-access-27cqm") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "kube-api-access-27cqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:26:28.940951 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:28.940927    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-web-config" (OuterVolumeSpecName: "web-config") pod "eb7f2985-2218-428a-9347-a1e52f6998fd" (UID: "eb7f2985-2218-428a-9347-a1e52f6998fd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:29.027314 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027284    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-config-out\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027314 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027310    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-tls-assets\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027314 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027320    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027330    2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-metrics-client-certs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027339    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027348    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027358    2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-kube-rbac-proxy\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027367    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27cqm\" (UniqueName: \"kubernetes.io/projected/eb7f2985-2218-428a-9347-a1e52f6998fd-kube-api-access-27cqm\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027376    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027387    2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027395    2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-grpc-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027403    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027412    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027421    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-web-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027428    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-db\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027436    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb7f2985-2218-428a-9347-a1e52f6998fd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.027511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.027444    2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb7f2985-2218-428a-9347-a1e52f6998fd-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:26:29.748782 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.748749    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb7f2985-2218-428a-9347-a1e52f6998fd","Type":"ContainerDied","Data":"75cda0ac7c2f3d0b252d4244f43937af09a2acf527e4ca21509ca0a167be6faa"}
Jul 13 15:26:29.749176 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.748801    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.749176 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.748826    2556 scope.go:117] "RemoveContainer" containerID="829753d0606b292c1072b2d45272fb229fe3a3cbb7ec2a30c6cac681aef82917"
Jul 13 15:26:29.756427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.756408    2556 scope.go:117] "RemoveContainer" containerID="3c0f7fe8acca0a337b6961d7bea1c2d5efa701068daf2a54b689c08589b4a639"
Jul 13 15:26:29.763600 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.763574    2556 scope.go:117] "RemoveContainer" containerID="02e4d7a0cd2f96a695fa66d0648d054743548399409ce6db09374d6e2c0c5c5d"
Jul 13 15:26:29.769877 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.769860    2556 scope.go:117] "RemoveContainer" containerID="1ea1252a1e0810ee8dc19712c9e7c3eb2cf2cec07d6f47ffc54d6284b1930dcc"
Jul 13 15:26:29.776346 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.776329    2556 scope.go:117] "RemoveContainer" containerID="e03b428d574cd686cb6d6817b4a0b7d9c931c94a193b6570caf5e2d622901dd7"
Jul 13 15:26:29.778346 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.778325    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:26:29.782955 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.782938    2556 scope.go:117] "RemoveContainer" containerID="891e5dc35eb12d853a313a218d430eb11c192774cc5e16d48d539fa99fe10075"
Jul 13 15:26:29.789443 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.789424    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:26:29.789685 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.789666    2556 scope.go:117] "RemoveContainer" containerID="edbfebfb1f9b2c81234eceb5c96525ff85a8e9e717f4995119a0b8b3f1124f4b"
Jul 13 15:26:29.829128 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829100    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:26:29.829509 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829490    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-thanos"
Jul 13 15:26:29.829562 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829514    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-thanos"
Jul 13 15:26:29.829562 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829543    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="prometheus"
Jul 13 15:26:29.829562 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829554    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="prometheus"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829566    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="thanos-sidecar"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829576    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="thanos-sidecar"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829589    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="init-config-reloader"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829596    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="init-config-reloader"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829612    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="config-reloader"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829620    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="config-reloader"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829630    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-web"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829638    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-web"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829646    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829654    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829665    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7207ae90-3106-485c-8934-c5e2572e59d8" containerName="console"
Jul 13 15:26:29.829697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829674    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7207ae90-3106-485c-8934-c5e2572e59d8" containerName="console"
Jul 13 15:26:29.830062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829746    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="prometheus"
Jul 13 15:26:29.830062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829757    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-web"
Jul 13 15:26:29.830062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829766    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy"
Jul 13 15:26:29.830062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829775    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7207ae90-3106-485c-8934-c5e2572e59d8" containerName="console"
Jul 13 15:26:29.830062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829784    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="thanos-sidecar"
Jul 13 15:26:29.830062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829791    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="kube-rbac-proxy-thanos"
Jul 13 15:26:29.830062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.829799    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" containerName="config-reloader"
Jul 13 15:26:29.833239 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.833224    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.843090 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843067    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 15:26:29.843210 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843127    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 15:26:29.843210 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843153    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 15:26:29.843210 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843188    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 15:26:29.843397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843247    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 15:26:29.843397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843358    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 15:26:29.843497 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843429    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 15:26:29.843541 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843521    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 15:26:29.843823 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843809    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 15:26:29.843991 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.843977    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 15:26:29.844065 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.844050    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-md52n\""
Jul 13 15:26:29.844136 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.844122    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 15:26:29.844178 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.844136    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dhs15q84ghk47\""
Jul 13 15:26:29.844371 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.844357    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 15:26:29.849837 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.849822    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 15:26:29.855792 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.855743    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 15:26:29.856465 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.856444    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:26:29.934284 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934284 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934332    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934357    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qncfz\" (UniqueName: \"kubernetes.io/projected/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-kube-api-access-qncfz\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934389    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934443    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-config\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934475 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934470    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934503    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934543    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934560    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934582    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934615    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934638    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:29.934948 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:29.934700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.035854 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.035818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-config\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.035854 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.035855    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036033 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.035873    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036033 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.035991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036033 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036027    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036174 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036049    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036174 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036174 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036103    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036174 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036158    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036208    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036236    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036292    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036427 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036751 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036751 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036488    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036751 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qncfz\" (UniqueName: \"kubernetes.io/projected/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-kube-api-access-qncfz\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.036751 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.036544    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.037110 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.037081    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.037110 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.037096    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.037524 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.037503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.037754 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.037736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.037829 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.037734    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.039001 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.038972    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.039106 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.039051    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.039106 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.039058    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-config\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.039106 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.039058    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.040574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.039695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.040574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.039881    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.040574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.040453    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.040574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.040520    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.040574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.040529    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.040784 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.040758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.041511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.041488    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.042500 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.042481    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.042562 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.042547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.042776 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.042754    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.049600 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.049581    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qncfz\" (UniqueName: \"kubernetes.io/projected/ec8aa1ed-faf7-4c90-9a91-877da425a9d9-kube-api-access-qncfz\") pod \"prometheus-k8s-0\" (UID: \"ec8aa1ed-faf7-4c90-9a91-877da425a9d9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.141684 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.141602    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:30.278775 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.278750    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 15:26:30.281254 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:26:30.281231    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8aa1ed_faf7_4c90_9a91_877da425a9d9.slice/crio-3443092acb61f2de6e87b806c19c5a13f24d1268ad5830b69bbbca124489685d WatchSource:0}: Error finding container 3443092acb61f2de6e87b806c19c5a13f24d1268ad5830b69bbbca124489685d: Status 404 returned error can't find the container with id 3443092acb61f2de6e87b806c19c5a13f24d1268ad5830b69bbbca124489685d
Jul 13 15:26:30.757804 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.757766    2556 generic.go:356] "Generic (PLEG): container finished" podID="ec8aa1ed-faf7-4c90-9a91-877da425a9d9" containerID="be4248063fb4470c2fa07245f6af86b11d9fef74956fb9433055520ba2292790" exitCode=0
Jul 13 15:26:30.758178 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.757814    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerDied","Data":"be4248063fb4470c2fa07245f6af86b11d9fef74956fb9433055520ba2292790"}
Jul 13 15:26:30.758178 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:30.757900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerStarted","Data":"3443092acb61f2de6e87b806c19c5a13f24d1268ad5830b69bbbca124489685d"}
Jul 13 15:26:31.078611 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.078583    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb7f2985-2218-428a-9347-a1e52f6998fd" path="/var/lib/kubelet/pods/eb7f2985-2218-428a-9347-a1e52f6998fd/volumes"
Jul 13 15:26:31.767458 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.767426    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerStarted","Data":"1500581b80fe813105647853d6a24e51cecd5fad391a85f0a59053929c87cf2b"}
Jul 13 15:26:31.767822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.767488    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerStarted","Data":"fcefeb3834c62b91d92e9f62e814b4aef3787f1143a9a930559aa94f4c45066e"}
Jul 13 15:26:31.767822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.767514    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerStarted","Data":"834dba3ac2c6543c20a638dc440530ec3aca0ed940d6b93174dc5f7321ebe3c2"}
Jul 13 15:26:31.767822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.767540    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerStarted","Data":"03a6f94de1162063b31a6c86a4b80ab439d4427ff07284bbd2495c95a0e4d89b"}
Jul 13 15:26:31.767822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.767562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerStarted","Data":"75670352157ce5973118282fc2c95ec528841661b471be8ff55765b7be6f2526"}
Jul 13 15:26:31.767822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.767584    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8aa1ed-faf7-4c90-9a91-877da425a9d9","Type":"ContainerStarted","Data":"1496c1480bf6ab5afdee59a6103123b62d6b4c415c611b75a60c143e35f74dc2"}
Jul 13 15:26:31.801762 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:31.801702    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.783723689 podStartE2EDuration="2.801681959s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.95827ms" isStatefulPod=false podCreationTimestamp="2026-07-13 15:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:26:31.799259467 +0000 UTC m=+145.359949956" watchObservedRunningTime="2026-07-13 15:26:31.801681959 +0000 UTC m=+145.362372449"
Jul 13 15:26:35.141855 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:35.141822    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:26:39.858603 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:26:39.858568    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7589bd65-qfn4p"]
Jul 13 15:27:04.878021 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:04.877917    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d7589bd65-qfn4p" podUID="803f8491-f2d7-4e67-b262-61baa2aac466" containerName="console" containerID="cri-o://d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684" gracePeriod=15
Jul 13 15:27:05.118575 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.118550    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:27:05.227587 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.227559    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-console-config\") pod \"803f8491-f2d7-4e67-b262-61baa2aac466\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") "
Jul 13 15:27:05.227750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.227594    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-serving-cert\") pod \"803f8491-f2d7-4e67-b262-61baa2aac466\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") "
Jul 13 15:27:05.227750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.227619    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-oauth-config\") pod \"803f8491-f2d7-4e67-b262-61baa2aac466\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") "
Jul 13 15:27:05.227750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.227648    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-oauth-serving-cert\") pod \"803f8491-f2d7-4e67-b262-61baa2aac466\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") "
Jul 13 15:27:05.227750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.227672    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-trusted-ca-bundle\") pod \"803f8491-f2d7-4e67-b262-61baa2aac466\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") "
Jul 13 15:27:05.227750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.227739    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5svbx\" (UniqueName: \"kubernetes.io/projected/803f8491-f2d7-4e67-b262-61baa2aac466-kube-api-access-5svbx\") pod \"803f8491-f2d7-4e67-b262-61baa2aac466\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") "
Jul 13 15:27:05.228007 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.227782    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-service-ca\") pod \"803f8491-f2d7-4e67-b262-61baa2aac466\" (UID: \"803f8491-f2d7-4e67-b262-61baa2aac466\") "
Jul 13 15:27:05.228068 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.228051    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-console-config" (OuterVolumeSpecName: "console-config") pod "803f8491-f2d7-4e67-b262-61baa2aac466" (UID: "803f8491-f2d7-4e67-b262-61baa2aac466"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:27:05.228212 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.228107    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "803f8491-f2d7-4e67-b262-61baa2aac466" (UID: "803f8491-f2d7-4e67-b262-61baa2aac466"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:27:05.228301 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.228205    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "803f8491-f2d7-4e67-b262-61baa2aac466" (UID: "803f8491-f2d7-4e67-b262-61baa2aac466"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:27:05.228366 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.228336    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-service-ca" (OuterVolumeSpecName: "service-ca") pod "803f8491-f2d7-4e67-b262-61baa2aac466" (UID: "803f8491-f2d7-4e67-b262-61baa2aac466"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:27:05.229729 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.229704    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "803f8491-f2d7-4e67-b262-61baa2aac466" (UID: "803f8491-f2d7-4e67-b262-61baa2aac466"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:27:05.229846 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.229820    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "803f8491-f2d7-4e67-b262-61baa2aac466" (UID: "803f8491-f2d7-4e67-b262-61baa2aac466"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:27:05.229890 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.229840    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803f8491-f2d7-4e67-b262-61baa2aac466-kube-api-access-5svbx" (OuterVolumeSpecName: "kube-api-access-5svbx") pod "803f8491-f2d7-4e67-b262-61baa2aac466" (UID: "803f8491-f2d7-4e67-b262-61baa2aac466"). InnerVolumeSpecName "kube-api-access-5svbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:27:05.329188 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.329156    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-console-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:27:05.329188 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.329182    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:27:05.329188 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.329193    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/803f8491-f2d7-4e67-b262-61baa2aac466-console-oauth-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:27:05.329419 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.329201    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-oauth-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:27:05.329419 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.329210    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-trusted-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:27:05.329419 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.329218    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5svbx\" (UniqueName: \"kubernetes.io/projected/803f8491-f2d7-4e67-b262-61baa2aac466-kube-api-access-5svbx\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:27:05.329419 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.329226    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/803f8491-f2d7-4e67-b262-61baa2aac466-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:27:05.893256 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.893223    2556 generic.go:356] "Generic (PLEG): container finished" podID="803f8491-f2d7-4e67-b262-61baa2aac466" containerID="d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684" exitCode=0
Jul 13 15:27:05.893635 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.893301    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7589bd65-qfn4p"
Jul 13 15:27:05.893635 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.893316    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7589bd65-qfn4p" event={"ID":"803f8491-f2d7-4e67-b262-61baa2aac466","Type":"ContainerDied","Data":"d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684"}
Jul 13 15:27:05.893635 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.893403    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7589bd65-qfn4p" event={"ID":"803f8491-f2d7-4e67-b262-61baa2aac466","Type":"ContainerDied","Data":"aa340b527d9c5b045fb63533e811105ece35668c122a8e9484079136b38314a1"}
Jul 13 15:27:05.893635 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.893430    2556 scope.go:117] "RemoveContainer" containerID="d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684"
Jul 13 15:27:05.902111 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.902096    2556 scope.go:117] "RemoveContainer" containerID="d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684"
Jul 13 15:27:05.902331 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:27:05.902311    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684\": container with ID starting with d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684 not found: ID does not exist" containerID="d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684"
Jul 13 15:27:05.902404 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.902339    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684"} err="failed to get container status \"d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684\": rpc error: code = NotFound desc = could not find container \"d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684\": container with ID starting with d7f6e994a48fd0f8208dcffeabeda2edf3011adecbca1ea12f9e0564da4ba684 not found: ID does not exist"
Jul 13 15:27:05.916066 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.916045    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7589bd65-qfn4p"]
Jul 13 15:27:05.921107 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:05.921088    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7589bd65-qfn4p"]
Jul 13 15:27:07.077479 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:07.077449    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803f8491-f2d7-4e67-b262-61baa2aac466" path="/var/lib/kubelet/pods/803f8491-f2d7-4e67-b262-61baa2aac466/volumes"
Jul 13 15:27:30.142138 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:30.142104    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:27:30.157302 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:30.157254    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:27:30.994429 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:27:30.994405    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 15:28:06.350316 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.350285    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vwmr9"]
Jul 13 15:28:06.350728 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.350549    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803f8491-f2d7-4e67-b262-61baa2aac466" containerName="console"
Jul 13 15:28:06.350728 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.350560    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="803f8491-f2d7-4e67-b262-61baa2aac466" containerName="console"
Jul 13 15:28:06.350728 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.350612    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="803f8491-f2d7-4e67-b262-61baa2aac466" containerName="console"
Jul 13 15:28:06.352326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.352312    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.354559 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.354537    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 13 15:28:06.354696 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.354599    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 13 15:28:06.355356 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.355339    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wzwgz\""
Jul 13 15:28:06.366045 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.366020    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vwmr9"]
Jul 13 15:28:06.509445 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.509412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4083fd2a-c257-41ff-94a5-da4758e5c787-bound-sa-token\") pod \"cert-manager-55b4d954d5-vwmr9\" (UID: \"4083fd2a-c257-41ff-94a5-da4758e5c787\") " pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.509592 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.509458    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx6zj\" (UniqueName: \"kubernetes.io/projected/4083fd2a-c257-41ff-94a5-da4758e5c787-kube-api-access-jx6zj\") pod \"cert-manager-55b4d954d5-vwmr9\" (UID: \"4083fd2a-c257-41ff-94a5-da4758e5c787\") " pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.610854 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.610790    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6zj\" (UniqueName: \"kubernetes.io/projected/4083fd2a-c257-41ff-94a5-da4758e5c787-kube-api-access-jx6zj\") pod \"cert-manager-55b4d954d5-vwmr9\" (UID: \"4083fd2a-c257-41ff-94a5-da4758e5c787\") " pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.610854 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.610859    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4083fd2a-c257-41ff-94a5-da4758e5c787-bound-sa-token\") pod \"cert-manager-55b4d954d5-vwmr9\" (UID: \"4083fd2a-c257-41ff-94a5-da4758e5c787\") " pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.620415 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.620387    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4083fd2a-c257-41ff-94a5-da4758e5c787-bound-sa-token\") pod \"cert-manager-55b4d954d5-vwmr9\" (UID: \"4083fd2a-c257-41ff-94a5-da4758e5c787\") " pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.620520 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.620468    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6zj\" (UniqueName: \"kubernetes.io/projected/4083fd2a-c257-41ff-94a5-da4758e5c787-kube-api-access-jx6zj\") pod \"cert-manager-55b4d954d5-vwmr9\" (UID: \"4083fd2a-c257-41ff-94a5-da4758e5c787\") " pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.673442 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.673415    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vwmr9"
Jul 13 15:28:06.676306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.676281    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"]
Jul 13 15:28:06.678291 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.678256    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:06.682361 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.682339    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 15:28:06.682608 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.682585    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:28:06.683156 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.683141    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nl86w\""
Jul 13 15:28:06.692250 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.692227    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"]
Jul 13 15:28:06.808179 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.808157    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vwmr9"]
Jul 13 15:28:06.809700 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:28:06.809677    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4083fd2a_c257_41ff_94a5_da4758e5c787.slice/crio-d6a1b993195d3870a3a62175f1d3833157bf3da2b8ee42fcdc1ab9e7909a861e WatchSource:0}: Error finding container d6a1b993195d3870a3a62175f1d3833157bf3da2b8ee42fcdc1ab9e7909a861e: Status 404 returned error can't find the container with id d6a1b993195d3870a3a62175f1d3833157bf3da2b8ee42fcdc1ab9e7909a861e
Jul 13 15:28:06.811745 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.811722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79p5j\" (UniqueName: \"kubernetes.io/projected/75552e6c-6c66-4bc3-a56b-1a88e9084451-kube-api-access-79p5j\") pod \"openshift-lws-operator-fd8ccff4c-vbl84\" (UID: \"75552e6c-6c66-4bc3-a56b-1a88e9084451\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:06.811820 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.811755    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75552e6c-6c66-4bc3-a56b-1a88e9084451-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vbl84\" (UID: \"75552e6c-6c66-4bc3-a56b-1a88e9084451\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:06.912675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.912643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79p5j\" (UniqueName: \"kubernetes.io/projected/75552e6c-6c66-4bc3-a56b-1a88e9084451-kube-api-access-79p5j\") pod \"openshift-lws-operator-fd8ccff4c-vbl84\" (UID: \"75552e6c-6c66-4bc3-a56b-1a88e9084451\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:06.912840 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.912681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75552e6c-6c66-4bc3-a56b-1a88e9084451-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vbl84\" (UID: \"75552e6c-6c66-4bc3-a56b-1a88e9084451\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:06.912998 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.912980    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75552e6c-6c66-4bc3-a56b-1a88e9084451-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vbl84\" (UID: \"75552e6c-6c66-4bc3-a56b-1a88e9084451\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:06.922880 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.922852    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 15:28:06.932724 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.932706    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:28:06.942506 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:06.942486    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79p5j\" (UniqueName: \"kubernetes.io/projected/75552e6c-6c66-4bc3-a56b-1a88e9084451-kube-api-access-79p5j\") pod \"openshift-lws-operator-fd8ccff4c-vbl84\" (UID: \"75552e6c-6c66-4bc3-a56b-1a88e9084451\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:07.002466 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:07.002438    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nl86w\""
Jul 13 15:28:07.010340 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:07.010325    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"
Jul 13 15:28:07.112373 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:07.112327    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vwmr9" event={"ID":"4083fd2a-c257-41ff-94a5-da4758e5c787","Type":"ContainerStarted","Data":"d6a1b993195d3870a3a62175f1d3833157bf3da2b8ee42fcdc1ab9e7909a861e"}
Jul 13 15:28:07.144696 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:07.144662    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84"]
Jul 13 15:28:07.147669 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:28:07.147644    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75552e6c_6c66_4bc3_a56b_1a88e9084451.slice/crio-157c5c05c3ba50f2a882e9a2e39250a0bd803799b1abbafc2c52f139b9de6a75 WatchSource:0}: Error finding container 157c5c05c3ba50f2a882e9a2e39250a0bd803799b1abbafc2c52f139b9de6a75: Status 404 returned error can't find the container with id 157c5c05c3ba50f2a882e9a2e39250a0bd803799b1abbafc2c52f139b9de6a75
Jul 13 15:28:08.119933 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:08.119890    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84" event={"ID":"75552e6c-6c66-4bc3-a56b-1a88e9084451","Type":"ContainerStarted","Data":"157c5c05c3ba50f2a882e9a2e39250a0bd803799b1abbafc2c52f139b9de6a75"}
Jul 13 15:28:12.138812 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:12.138773    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vwmr9" event={"ID":"4083fd2a-c257-41ff-94a5-da4758e5c787","Type":"ContainerStarted","Data":"3c5663005350426297ac1c6d6afbd19e044d3c3b4950f920c7d06338714c30cd"}
Jul 13 15:28:12.140488 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:12.140455    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84" event={"ID":"75552e6c-6c66-4bc3-a56b-1a88e9084451","Type":"ContainerStarted","Data":"869949f101605233cda97b873d1e26cc1ef9c8bf427c689aa3aed53080cdcc25"}
Jul 13 15:28:12.160003 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:12.159958    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vwmr9" podStartSLOduration=1.6872906730000001 podStartE2EDuration="6.159943135s" totalImagesPullingTime="4.472652462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:12.158748376 +0000 UTC m=+245.719438862" watchObservedRunningTime="2026-07-13 15:28:12.159943135 +0000 UTC m=+245.720633621"
Jul 13 15:28:12.180121 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:12.180055    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vbl84" podStartSLOduration=2.034689147 podStartE2EDuration="6.180034267s" totalImagesPullingTime="4.14534512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:12.178514649 +0000 UTC m=+245.739205152" watchObservedRunningTime="2026-07-13 15:28:12.180034267 +0000 UTC m=+245.740724755"
Jul 13 15:28:32.840887 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.840816    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"]
Jul 13 15:28:32.843939 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.843924    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:32.847428 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.847410    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 15:28:32.847641 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.847613    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 15:28:32.847874 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.847859    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rbd9j\""
Jul 13 15:28:32.847948 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.847933    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 15:28:32.848199 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.848180    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 15:28:32.862761 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.862741    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"]
Jul 13 15:28:32.914715 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.914681    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg784\" (UniqueName: \"kubernetes.io/projected/f74b1839-bc26-4428-9f74-174b749f2d73-kube-api-access-zg784\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:32.914863 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.914723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f74b1839-bc26-4428-9f74-174b749f2d73-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:32.914863 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.914753    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f74b1839-bc26-4428-9f74-174b749f2d73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:32.914863 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.914803    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74b1839-bc26-4428-9f74-174b749f2d73-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:32.914962 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:32.914865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f74b1839-bc26-4428-9f74-174b749f2d73-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.016008 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.015979    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74b1839-bc26-4428-9f74-174b749f2d73-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.016145 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.016024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f74b1839-bc26-4428-9f74-174b749f2d73-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.016145 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.016078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg784\" (UniqueName: \"kubernetes.io/projected/f74b1839-bc26-4428-9f74-174b749f2d73-kube-api-access-zg784\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.016145 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.016101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f74b1839-bc26-4428-9f74-174b749f2d73-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.016145 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.016122    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f74b1839-bc26-4428-9f74-174b749f2d73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.016548 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.016522    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f74b1839-bc26-4428-9f74-174b749f2d73-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.018421 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.018393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74b1839-bc26-4428-9f74-174b749f2d73-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.018532 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.018507    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f74b1839-bc26-4428-9f74-174b749f2d73-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.018582 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.018547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f74b1839-bc26-4428-9f74-174b749f2d73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.028678 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.028659    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg784\" (UniqueName: \"kubernetes.io/projected/f74b1839-bc26-4428-9f74-174b749f2d73-kube-api-access-zg784\") pod \"opendatahub-operator-controller-manager-7695c54b44-rrjkx\" (UID: \"f74b1839-bc26-4428-9f74-174b749f2d73\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.154669 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.154571    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:33.299770 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:33.299726    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"]
Jul 13 15:28:33.304377 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:28:33.304348    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74b1839_bc26_4428_9f74_174b749f2d73.slice/crio-b8dbffe59ab438c103232a5404fa410c432a6827e4ee49b27016d1e23c0fb4bf WatchSource:0}: Error finding container b8dbffe59ab438c103232a5404fa410c432a6827e4ee49b27016d1e23c0fb4bf: Status 404 returned error can't find the container with id b8dbffe59ab438c103232a5404fa410c432a6827e4ee49b27016d1e23c0fb4bf
Jul 13 15:28:34.220745 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:34.220713    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx" event={"ID":"f74b1839-bc26-4428-9f74-174b749f2d73","Type":"ContainerStarted","Data":"b8dbffe59ab438c103232a5404fa410c432a6827e4ee49b27016d1e23c0fb4bf"}
Jul 13 15:28:37.237287 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:37.237234    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx" event={"ID":"f74b1839-bc26-4428-9f74-174b749f2d73","Type":"ContainerStarted","Data":"77b7d648fb43fdca192c91f5214a89905ba334673823c792a4f176d2a8a99dec"}
Jul 13 15:28:38.242787 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:38.242757    2556 generic.go:356] "Generic (PLEG): container finished" podID="f74b1839-bc26-4428-9f74-174b749f2d73" containerID="77b7d648fb43fdca192c91f5214a89905ba334673823c792a4f176d2a8a99dec" exitCode=0
Jul 13 15:28:38.243153 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:38.242805    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx" event={"ID":"f74b1839-bc26-4428-9f74-174b749f2d73","Type":"ContainerDied","Data":"77b7d648fb43fdca192c91f5214a89905ba334673823c792a4f176d2a8a99dec"}
Jul 13 15:28:39.248357 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:39.248323    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx" event={"ID":"f74b1839-bc26-4428-9f74-174b749f2d73","Type":"ContainerStarted","Data":"e1f529b8d41adb1fa81a26b2ee827e6745bbfb75ddeaa5f181c03a23e72762f9"}
Jul 13 15:28:39.248754 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:39.248475    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:39.300621 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:39.300573    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx" podStartSLOduration=2.410229979 podStartE2EDuration="7.300557438s" totalImagesPullingTime="3.726526767s" totalInitContainerRuntime="1.163800692s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:39.297442832 +0000 UTC m=+272.858133319" watchObservedRunningTime="2026-07-13 15:28:39.300557438 +0000 UTC m=+272.861247925"
Jul 13 15:28:50.254566 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:50.254532    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-rrjkx"
Jul 13 15:28:53.492185 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.492155    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"]
Jul 13 15:28:53.499873 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.499847    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.503041 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.503014    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 15:28:53.503987 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.503967    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 15:28:53.504731 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.504705    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 15:28:53.504731 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.504719    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hdtjj\""
Jul 13 15:28:53.504894 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.504754    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 15:28:53.507929 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.507906    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"]
Jul 13 15:28:53.589065 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.589028    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cllz9\" (UniqueName: \"kubernetes.io/projected/3994874e-5e66-4c72-8bc9-352011d490b6-kube-api-access-cllz9\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.589065 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.589063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3994874e-5e66-4c72-8bc9-352011d490b6-tmp\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.589344 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.589094    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3994874e-5e66-4c72-8bc9-352011d490b6-tls-certs\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.690460 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.690424    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cllz9\" (UniqueName: \"kubernetes.io/projected/3994874e-5e66-4c72-8bc9-352011d490b6-kube-api-access-cllz9\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.690655 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.690477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3994874e-5e66-4c72-8bc9-352011d490b6-tmp\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.690655 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.690498    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3994874e-5e66-4c72-8bc9-352011d490b6-tls-certs\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.692858 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.692835    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3994874e-5e66-4c72-8bc9-352011d490b6-tmp\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.693078 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.693056    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3994874e-5e66-4c72-8bc9-352011d490b6-tls-certs\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.714285 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.714230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cllz9\" (UniqueName: \"kubernetes.io/projected/3994874e-5e66-4c72-8bc9-352011d490b6-kube-api-access-cllz9\") pod \"kube-auth-proxy-6f57b96f59-fqcqz\" (UID: \"3994874e-5e66-4c72-8bc9-352011d490b6\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.810299 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.810249    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"
Jul 13 15:28:53.956100 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:53.956076    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz"]
Jul 13 15:28:53.958535 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:28:53.958505    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3994874e_5e66_4c72_8bc9_352011d490b6.slice/crio-c9a566082a2e87f6b47d2d1e869ea82b90b41e44111f2302335ac7c3bfcc8999 WatchSource:0}: Error finding container c9a566082a2e87f6b47d2d1e869ea82b90b41e44111f2302335ac7c3bfcc8999: Status 404 returned error can't find the container with id c9a566082a2e87f6b47d2d1e869ea82b90b41e44111f2302335ac7c3bfcc8999
Jul 13 15:28:54.310957 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:54.310872    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz" event={"ID":"3994874e-5e66-4c72-8bc9-352011d490b6","Type":"ContainerStarted","Data":"c9a566082a2e87f6b47d2d1e869ea82b90b41e44111f2302335ac7c3bfcc8999"}
Jul 13 15:28:57.326674 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:57.326639    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz" event={"ID":"3994874e-5e66-4c72-8bc9-352011d490b6","Type":"ContainerStarted","Data":"d362501053cf99078fd6ff10cd409c0503402461cf924876d09fe37d9c94ea07"}
Jul 13 15:28:57.344006 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:28:57.343957    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-fqcqz" podStartSLOduration=1.200057753 podStartE2EDuration="4.343942348s" totalImagesPullingTime="3.143884595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:57.342629745 +0000 UTC m=+290.903320233" watchObservedRunningTime="2026-07-13 15:28:57.343942348 +0000 UTC m=+290.904632836"
Jul 13 15:29:00.928107 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:00.928075    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"]
Jul 13 15:29:00.931210 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:00.931195    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:00.935022 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:00.935000    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p2687\""
Jul 13 15:29:00.935703 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:00.935685    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 15:29:00.972606 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:00.972580    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"]
Jul 13 15:29:01.057791 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.057745    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.057986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.057828    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.057986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.057866    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbxjf\" (UniqueName: \"kubernetes.io/projected/833aae9c-60a2-4dc5-8c8c-522d715da520-kube-api-access-tbxjf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.057986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.057901    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.057986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.057927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.057986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.057979    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.058246 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.058047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.058246 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.058064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.058246 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.058086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833aae9c-60a2-4dc5-8c8c-522d715da520-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.158644 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.158608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.158644 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.158649    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.158897 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.158842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.159907 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.159465    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.159907 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.159519    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.159907 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.159868    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.159907 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.159883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.160190 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.160123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833aae9c-60a2-4dc5-8c8c-522d715da520-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.160375 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.160191    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.160687 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.160660    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.161412 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.161386    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.161502 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.161467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833aae9c-60a2-4dc5-8c8c-522d715da520-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.161502 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.161478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.161604 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.161429    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbxjf\" (UniqueName: \"kubernetes.io/projected/833aae9c-60a2-4dc5-8c8c-522d715da520-kube-api-access-tbxjf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.164371 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.163496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.165357 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.164528    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.174937 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.174916    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbxjf\" (UniqueName: \"kubernetes.io/projected/833aae9c-60a2-4dc5-8c8c-522d715da520-kube-api-access-tbxjf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.178180 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.178129    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833aae9c-60a2-4dc5-8c8c-522d715da520-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg5v4\" (UID: \"833aae9c-60a2-4dc5-8c8c-522d715da520\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.240977 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.240942    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:01.390748 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.390723    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"]
Jul 13 15:29:01.393926 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:29:01.393899    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833aae9c_60a2_4dc5_8c8c_522d715da520.slice/crio-2c736847bf57bcf6e8b9cee44f845f1b17d9293b650540e5324e5108caf96f2f WatchSource:0}: Error finding container 2c736847bf57bcf6e8b9cee44f845f1b17d9293b650540e5324e5108caf96f2f: Status 404 returned error can't find the container with id 2c736847bf57bcf6e8b9cee44f845f1b17d9293b650540e5324e5108caf96f2f
Jul 13 15:29:01.729307 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.729276    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"]
Jul 13 15:29:01.733849 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.733825    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.736351 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.736307    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 15:29:01.736511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.736495    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 15:29:01.736652 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.736513    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 15:29:01.736864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.736850    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rh762\""
Jul 13 15:29:01.751901 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.751867    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"]
Jul 13 15:29:01.867258 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.867221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.867258 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.867286    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.867532 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.867335    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svpx\" (UniqueName: \"kubernetes.io/projected/40b68ba6-2837-4404-a3ec-2caf279b52c1-kube-api-access-2svpx\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.867532 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.867378    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.867532 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.867444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b68ba6-2837-4404-a3ec-2caf279b52c1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.867532 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.867496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.867690 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.867532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.968067 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.968033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.968067 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.968072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.968567 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.968199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svpx\" (UniqueName: \"kubernetes.io/projected/40b68ba6-2837-4404-a3ec-2caf279b52c1-kube-api-access-2svpx\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.968567 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.968312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.968567 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.968359    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b68ba6-2837-4404-a3ec-2caf279b52c1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.968567 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.968389    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.968567 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.968422    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.969259 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.969228    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.970545 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.970525    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.970651 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.970611    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.970651 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.970639    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b68ba6-2837-4404-a3ec-2caf279b52c1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.970818 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.970801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.979134 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.979114    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b68ba6-2837-4404-a3ec-2caf279b52c1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:01.990043 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:01.989967    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svpx\" (UniqueName: \"kubernetes.io/projected/40b68ba6-2837-4404-a3ec-2caf279b52c1-kube-api-access-2svpx\") pod \"istiod-openshift-gateway-94bb8fbfd-hmv2f\" (UID: \"40b68ba6-2837-4404-a3ec-2caf279b52c1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:02.043865 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:02.043823    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:02.182515 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:02.182480    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"]
Jul 13 15:29:02.186049 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:29:02.186011    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b68ba6_2837_4404_a3ec_2caf279b52c1.slice/crio-d33c518bf3f5c03a1a75ad21ffbbce56b846b4110fca753227c4028a123b339c WatchSource:0}: Error finding container d33c518bf3f5c03a1a75ad21ffbbce56b846b4110fca753227c4028a123b339c: Status 404 returned error can't find the container with id d33c518bf3f5c03a1a75ad21ffbbce56b846b4110fca753227c4028a123b339c
Jul 13 15:29:02.348789 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:02.348705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f" event={"ID":"40b68ba6-2837-4404-a3ec-2caf279b52c1","Type":"ContainerStarted","Data":"d33c518bf3f5c03a1a75ad21ffbbce56b846b4110fca753227c4028a123b339c"}
Jul 13 15:29:02.349842 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:02.349818    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4" event={"ID":"833aae9c-60a2-4dc5-8c8c-522d715da520","Type":"ContainerStarted","Data":"2c736847bf57bcf6e8b9cee44f845f1b17d9293b650540e5324e5108caf96f2f"}
Jul 13 15:29:04.579382 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:04.579346    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:29:04.579665 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:04.579411    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:29:05.341879 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.341846    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"]
Jul 13 15:29:05.345091 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.345059    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:05.347687 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.347664    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-j7ck6\""
Jul 13 15:29:05.348014 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.347995    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 15:29:05.370392 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.369118    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"]
Jul 13 15:29:05.373683 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.373536    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f" event={"ID":"40b68ba6-2837-4404-a3ec-2caf279b52c1","Type":"ContainerStarted","Data":"3cd23befc706cb52ccfe207109ea603153f08da42584200af3203f8eba5d05d9"}
Jul 13 15:29:05.374096 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.374045    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:05.375553 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.375512    2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-hmv2f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 15:29:05.375653 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.375584    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f" podUID="40b68ba6-2837-4404-a3ec-2caf279b52c1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:29:05.432191 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.432124    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f" podStartSLOduration=2.041632486 podStartE2EDuration="4.432106302s" totalImagesPullingTime="2.390473816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:05.430798774 +0000 UTC m=+298.991489262" watchObservedRunningTime="2026-07-13 15:29:05.432106302 +0000 UTC m=+298.992796791"
Jul 13 15:29:05.504058 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.503969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2cd\" (UniqueName: \"kubernetes.io/projected/29a7b7bd-3339-42f9-90e0-d9e16160e702-kube-api-access-7p2cd\") pod \"llmisvc-controller-manager-777c6bd7d5-llfp7\" (UID: \"29a7b7bd-3339-42f9-90e0-d9e16160e702\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:05.504238 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.504171    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a7b7bd-3339-42f9-90e0-d9e16160e702-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-llfp7\" (UID: \"29a7b7bd-3339-42f9-90e0-d9e16160e702\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:05.604931 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.604848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a7b7bd-3339-42f9-90e0-d9e16160e702-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-llfp7\" (UID: \"29a7b7bd-3339-42f9-90e0-d9e16160e702\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:05.604931 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.604919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2cd\" (UniqueName: \"kubernetes.io/projected/29a7b7bd-3339-42f9-90e0-d9e16160e702-kube-api-access-7p2cd\") pod \"llmisvc-controller-manager-777c6bd7d5-llfp7\" (UID: \"29a7b7bd-3339-42f9-90e0-d9e16160e702\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:05.607493 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.607463    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a7b7bd-3339-42f9-90e0-d9e16160e702-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-llfp7\" (UID: \"29a7b7bd-3339-42f9-90e0-d9e16160e702\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:05.615599 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.615577    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2cd\" (UniqueName: \"kubernetes.io/projected/29a7b7bd-3339-42f9-90e0-d9e16160e702-kube-api-access-7p2cd\") pod \"llmisvc-controller-manager-777c6bd7d5-llfp7\" (UID: \"29a7b7bd-3339-42f9-90e0-d9e16160e702\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:05.660147 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:05.659944    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:06.378867 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.378822    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hmv2f"
Jul 13 15:29:06.695965 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.695930    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:29:06.696247 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.696008    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:29:06.696247 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.696040    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:29:06.775369 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.775345    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"]
Jul 13 15:29:06.778020 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:29:06.777993    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29a7b7bd_3339_42f9_90e0_d9e16160e702.slice/crio-6f39754b95c5e679ce81fcffa0097e5cec21182378916975004d1569d304344a WatchSource:0}: Error finding container 6f39754b95c5e679ce81fcffa0097e5cec21182378916975004d1569d304344a: Status 404 returned error can't find the container with id 6f39754b95c5e679ce81fcffa0097e5cec21182378916975004d1569d304344a
Jul 13 15:29:06.855879 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.855838    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:29:06.867140 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.867113    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:29:06.867787 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:06.867763    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 15:29:07.388749 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:07.388715    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7" event={"ID":"29a7b7bd-3339-42f9-90e0-d9e16160e702","Type":"ContainerStarted","Data":"6f39754b95c5e679ce81fcffa0097e5cec21182378916975004d1569d304344a"}
Jul 13 15:29:07.425990 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:07.390379    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4" event={"ID":"833aae9c-60a2-4dc5-8c8c-522d715da520","Type":"ContainerStarted","Data":"df56e6744233fdb8a11e2c1c70593dffd07ab251c2a7310bd26395916afd9e20"}
Jul 13 15:29:07.425990 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:07.420807    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4" podStartSLOduration=2.121257297 podStartE2EDuration="7.42079064s" totalImagesPullingTime="5.299533343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:07.420702332 +0000 UTC m=+300.981392820" watchObservedRunningTime="2026-07-13 15:29:07.42079064 +0000 UTC m=+300.981481185"
Jul 13 15:29:08.241459 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:08.241428    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:08.246902 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:08.246879    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:08.397110 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:08.397068    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:08.398286 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:08.398222    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg5v4"
Jul 13 15:29:10.406532 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:10.406442    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7" event={"ID":"29a7b7bd-3339-42f9-90e0-d9e16160e702","Type":"ContainerStarted","Data":"8e5c893412b8d0303ac2136563738957607f687627eabbc6a06bedf874b06ffd"}
Jul 13 15:29:10.406532 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:10.406508    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:10.465438 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:10.465385    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7" podStartSLOduration=2.092027257 podStartE2EDuration="5.465364419s" totalImagesPullingTime="3.373337162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:10.464282009 +0000 UTC m=+304.024972489" watchObservedRunningTime="2026-07-13 15:29:10.465364419 +0000 UTC m=+304.026054908"
Jul 13 15:29:41.414039 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:41.414006    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-llfp7"
Jul 13 15:29:55.295083 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.295050    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhbs2"]
Jul 13 15:29:55.304283 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.304247    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:29:55.308750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.308728    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m5k7g\""
Jul 13 15:29:55.308881 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.308765    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 15:29:55.309454 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.309435    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 15:29:55.319292 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.319248    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhbs2"]
Jul 13 15:29:55.427430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.427402    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdzs9\" (UniqueName: \"kubernetes.io/projected/16969617-35c0-41ee-9365-a783ece857bc-kube-api-access-cdzs9\") pod \"kuadrant-operator-catalog-dhbs2\" (UID: \"16969617-35c0-41ee-9365-a783ece857bc\") " pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:29:55.528361 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.528328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdzs9\" (UniqueName: \"kubernetes.io/projected/16969617-35c0-41ee-9365-a783ece857bc-kube-api-access-cdzs9\") pod \"kuadrant-operator-catalog-dhbs2\" (UID: \"16969617-35c0-41ee-9365-a783ece857bc\") " pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:29:55.538874 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.538845    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdzs9\" (UniqueName: \"kubernetes.io/projected/16969617-35c0-41ee-9365-a783ece857bc-kube-api-access-cdzs9\") pod \"kuadrant-operator-catalog-dhbs2\" (UID: \"16969617-35c0-41ee-9365-a783ece857bc\") " pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:29:55.613292 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.613201    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:29:55.740644 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.740612    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhbs2"]
Jul 13 15:29:55.743146 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:29:55.743122    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16969617_35c0_41ee_9365_a783ece857bc.slice/crio-d81f2e64714ffed38ec4eba0dcef01c4344f54924b9e1a2994daed16ba68e900 WatchSource:0}: Error finding container d81f2e64714ffed38ec4eba0dcef01c4344f54924b9e1a2994daed16ba68e900: Status 404 returned error can't find the container with id d81f2e64714ffed38ec4eba0dcef01c4344f54924b9e1a2994daed16ba68e900
Jul 13 15:29:55.744952 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:55.744937    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:29:56.612215 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:56.612177    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2" event={"ID":"16969617-35c0-41ee-9365-a783ece857bc","Type":"ContainerStarted","Data":"d81f2e64714ffed38ec4eba0dcef01c4344f54924b9e1a2994daed16ba68e900"}
Jul 13 15:29:58.622673 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:58.622596    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2" event={"ID":"16969617-35c0-41ee-9365-a783ece857bc","Type":"ContainerStarted","Data":"de3899578dee798fd626fcbbcc36880ccee0e3f80a5b085ff5aa0c9531237995"}
Jul 13 15:29:58.640307 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:29:58.640236    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2" podStartSLOduration=1.134101505 podStartE2EDuration="3.640220074s" totalImagesPullingTime="2.506118569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:58.639508393 +0000 UTC m=+352.200198884" watchObservedRunningTime="2026-07-13 15:29:58.640220074 +0000 UTC m=+352.200910562"
Jul 13 15:30:05.613995 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:05.613963    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:30:05.614430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:05.614048    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:30:05.636864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:05.636840    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:30:05.679090 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:05.679058    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dhbs2"
Jul 13 15:30:26.150966 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.150932    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"]
Jul 13 15:30:26.155426 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.155408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:26.157943 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.157927    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-grvm8\""
Jul 13 15:30:26.166047 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.166025    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"]
Jul 13 15:30:26.298733 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.298699    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k72tl\" (UniqueName: \"kubernetes.io/projected/aa00d3a0-8df5-42ea-8ade-f6dc977bff36-kube-api-access-k72tl\") pod \"limitador-operator-controller-manager-859d7b78bd-w2rt6\" (UID: \"aa00d3a0-8df5-42ea-8ade-f6dc977bff36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:26.399715 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.399681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k72tl\" (UniqueName: \"kubernetes.io/projected/aa00d3a0-8df5-42ea-8ade-f6dc977bff36-kube-api-access-k72tl\") pod \"limitador-operator-controller-manager-859d7b78bd-w2rt6\" (UID: \"aa00d3a0-8df5-42ea-8ade-f6dc977bff36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:26.413777 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.413713    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k72tl\" (UniqueName: \"kubernetes.io/projected/aa00d3a0-8df5-42ea-8ade-f6dc977bff36-kube-api-access-k72tl\") pod \"limitador-operator-controller-manager-859d7b78bd-w2rt6\" (UID: \"aa00d3a0-8df5-42ea-8ade-f6dc977bff36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:26.465573 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.465543    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:26.608569 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.608540    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"]
Jul 13 15:30:26.612118 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:30:26.612093    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa00d3a0_8df5_42ea_8ade_f6dc977bff36.slice/crio-27605203573ba3038a6aa7095cd81d9cc178ee8af13575d57a3f73a1820183f9 WatchSource:0}: Error finding container 27605203573ba3038a6aa7095cd81d9cc178ee8af13575d57a3f73a1820183f9: Status 404 returned error can't find the container with id 27605203573ba3038a6aa7095cd81d9cc178ee8af13575d57a3f73a1820183f9
Jul 13 15:30:26.749276 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:26.749182    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6" event={"ID":"aa00d3a0-8df5-42ea-8ade-f6dc977bff36","Type":"ContainerStarted","Data":"27605203573ba3038a6aa7095cd81d9cc178ee8af13575d57a3f73a1820183f9"}
Jul 13 15:30:28.591540 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.591500    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5758758844-pbpk5"]
Jul 13 15:30:28.597059 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.597010    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.600382 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.600358    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 15:30:28.600552 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.600368    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 15:30:28.601131 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.601095    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 15:30:28.601516 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.601484    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 15:30:28.601690 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.601621    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 15:30:28.601898 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.601877    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mgdfp\""
Jul 13 15:30:28.605538 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.605517    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5758758844-pbpk5"]
Jul 13 15:30:28.606057 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.606037    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 15:30:28.720074 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.720046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a78e0c7-51ee-4b88-af73-e24af1639104-console-serving-cert\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.720074 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.720077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a78e0c7-51ee-4b88-af73-e24af1639104-console-oauth-config\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.720327 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.720100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-trusted-ca-bundle\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.720327 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.720180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlfhz\" (UniqueName: \"kubernetes.io/projected/6a78e0c7-51ee-4b88-af73-e24af1639104-kube-api-access-wlfhz\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.720327 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.720236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-service-ca\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.720327 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.720276    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-console-config\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.720537 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.720337    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-oauth-serving-cert\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.821309 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.821255    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-trusted-ca-bundle\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.821399 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.821340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlfhz\" (UniqueName: \"kubernetes.io/projected/6a78e0c7-51ee-4b88-af73-e24af1639104-kube-api-access-wlfhz\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.821399 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.821370    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-service-ca\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.821399 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.821392    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-console-config\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.821550 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.821458    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-oauth-serving-cert\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.821550 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.821496    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a78e0c7-51ee-4b88-af73-e24af1639104-console-serving-cert\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.821550 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.821523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a78e0c7-51ee-4b88-af73-e24af1639104-console-oauth-config\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.822076 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.822049    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-service-ca\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.822172 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.822103    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-trusted-ca-bundle\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.822172 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.822151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-oauth-serving-cert\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.822303 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.822171    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a78e0c7-51ee-4b88-af73-e24af1639104-console-config\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.823789 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.823768    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a78e0c7-51ee-4b88-af73-e24af1639104-console-oauth-config\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.823894 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.823878    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a78e0c7-51ee-4b88-af73-e24af1639104-console-serving-cert\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.832712 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.832692    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlfhz\" (UniqueName: \"kubernetes.io/projected/6a78e0c7-51ee-4b88-af73-e24af1639104-kube-api-access-wlfhz\") pod \"console-5758758844-pbpk5\" (UID: \"6a78e0c7-51ee-4b88-af73-e24af1639104\") " pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:28.911001 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:28.910980    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:29.042396 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:29.042357    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5758758844-pbpk5"]
Jul 13 15:30:29.045152 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:30:29.045124    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a78e0c7_51ee_4b88_af73_e24af1639104.slice/crio-31eab2e9c0723bebad68495b42eb2549258d398434b5f3daac1f5ec55fd137ab WatchSource:0}: Error finding container 31eab2e9c0723bebad68495b42eb2549258d398434b5f3daac1f5ec55fd137ab: Status 404 returned error can't find the container with id 31eab2e9c0723bebad68495b42eb2549258d398434b5f3daac1f5ec55fd137ab
Jul 13 15:30:29.765739 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:29.765696    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5758758844-pbpk5" event={"ID":"6a78e0c7-51ee-4b88-af73-e24af1639104","Type":"ContainerStarted","Data":"3cb84602349dbb4c0dad25cf8a8162fbee1de4fffb2c8361f8979a63984e0102"}
Jul 13 15:30:29.766193 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:29.765754    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5758758844-pbpk5" event={"ID":"6a78e0c7-51ee-4b88-af73-e24af1639104","Type":"ContainerStarted","Data":"31eab2e9c0723bebad68495b42eb2549258d398434b5f3daac1f5ec55fd137ab"}
Jul 13 15:30:29.767226 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:29.767205    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6" event={"ID":"aa00d3a0-8df5-42ea-8ade-f6dc977bff36","Type":"ContainerStarted","Data":"3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6"}
Jul 13 15:30:29.767340 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:29.767280    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:29.786377 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:29.786331    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5758758844-pbpk5" podStartSLOduration=1.7863183089999999 podStartE2EDuration="1.786318309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:29.784443544 +0000 UTC m=+383.345134032" watchObservedRunningTime="2026-07-13 15:30:29.786318309 +0000 UTC m=+383.347008796"
Jul 13 15:30:29.805956 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:29.805916    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6" podStartSLOduration=1.6484488370000001 podStartE2EDuration="3.805907245s" totalImagesPullingTime="2.157458408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:29.805375839 +0000 UTC m=+383.366066327" watchObservedRunningTime="2026-07-13 15:30:29.805907245 +0000 UTC m=+383.366597731"
Jul 13 15:30:33.926390 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:33.926353    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"]
Jul 13 15:30:33.930820 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:33.930793    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"
Jul 13 15:30:33.934093 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:33.934070    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f5kjg\""
Jul 13 15:30:33.942735 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:33.942716    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"]
Jul 13 15:30:34.073655 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:34.073618    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8qr\" (UniqueName: \"kubernetes.io/projected/57374d37-9c71-44da-8425-a7b979fd67e3-kube-api-access-gr8qr\") pod \"authorino-operator-75cc8d5cb7-4zcgz\" (UID: \"57374d37-9c71-44da-8425-a7b979fd67e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"
Jul 13 15:30:34.174591 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:34.174549    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8qr\" (UniqueName: \"kubernetes.io/projected/57374d37-9c71-44da-8425-a7b979fd67e3-kube-api-access-gr8qr\") pod \"authorino-operator-75cc8d5cb7-4zcgz\" (UID: \"57374d37-9c71-44da-8425-a7b979fd67e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"
Jul 13 15:30:34.187301 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:34.187213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8qr\" (UniqueName: \"kubernetes.io/projected/57374d37-9c71-44da-8425-a7b979fd67e3-kube-api-access-gr8qr\") pod \"authorino-operator-75cc8d5cb7-4zcgz\" (UID: \"57374d37-9c71-44da-8425-a7b979fd67e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"
Jul 13 15:30:34.241128 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:34.241098    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"
Jul 13 15:30:34.379152 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:34.379092    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"]
Jul 13 15:30:34.381699 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:30:34.381674    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57374d37_9c71_44da_8425_a7b979fd67e3.slice/crio-e2957c257acaa2079a7489b8d4202419aca6c291d3d5122712535d6915cba615 WatchSource:0}: Error finding container e2957c257acaa2079a7489b8d4202419aca6c291d3d5122712535d6915cba615: Status 404 returned error can't find the container with id e2957c257acaa2079a7489b8d4202419aca6c291d3d5122712535d6915cba615
Jul 13 15:30:34.792094 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:34.792060    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz" event={"ID":"57374d37-9c71-44da-8425-a7b979fd67e3","Type":"ContainerStarted","Data":"e2957c257acaa2079a7489b8d4202419aca6c291d3d5122712535d6915cba615"}
Jul 13 15:30:36.804847 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:36.804813    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz" event={"ID":"57374d37-9c71-44da-8425-a7b979fd67e3","Type":"ContainerStarted","Data":"2d3398c44d660e9bc3e623cf0e455f48328230d9b67c883ee05f1e9872f2efbe"}
Jul 13 15:30:36.805221 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:36.804942    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"
Jul 13 15:30:36.826993 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:36.826942    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz" podStartSLOduration=1.579588524 podStartE2EDuration="3.826922273s" totalImagesPullingTime="2.247333749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:36.825924076 +0000 UTC m=+390.386614563" watchObservedRunningTime="2026-07-13 15:30:36.826922273 +0000 UTC m=+390.387612761"
Jul 13 15:30:38.911721 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:38.911678    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:38.912120 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:38.911784    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:38.916314 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:38.916293    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:39.821780 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:39.821752    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5758758844-pbpk5"
Jul 13 15:30:40.775285 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:40.775233    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:47.811718 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:47.811688    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zcgz"
Jul 13 15:30:51.221243 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.221213    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"]
Jul 13 15:30:51.224054 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.224030    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.226584 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.226564    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q98wm\""
Jul 13 15:30:51.238133 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.238110    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"]
Jul 13 15:30:51.323080 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.323040    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z82df\" (UniqueName: \"kubernetes.io/projected/fc25c004-44e4-4671-951b-c1926e084b08-kube-api-access-z82df\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.323249 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.323145    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc25c004-44e4-4671-951b-c1926e084b08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.424487 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.424451    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc25c004-44e4-4671-951b-c1926e084b08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.424675 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.424514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z82df\" (UniqueName: \"kubernetes.io/projected/fc25c004-44e4-4671-951b-c1926e084b08-kube-api-access-z82df\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.424839 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.424818    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc25c004-44e4-4671-951b-c1926e084b08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.439897 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.439874    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z82df\" (UniqueName: \"kubernetes.io/projected/fc25c004-44e4-4671-951b-c1926e084b08-kube-api-access-z82df\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.534697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.534618    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:51.671086 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.670966    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"]
Jul 13 15:30:51.673496 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:30:51.673467    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc25c004_44e4_4671_951b_c1926e084b08.slice/crio-4a8b8b8c36b1ec87f478297a513f2c204fc5cb2522ed1877e6afd13e5e550955 WatchSource:0}: Error finding container 4a8b8b8c36b1ec87f478297a513f2c204fc5cb2522ed1877e6afd13e5e550955: Status 404 returned error can't find the container with id 4a8b8b8c36b1ec87f478297a513f2c204fc5cb2522ed1877e6afd13e5e550955
Jul 13 15:30:51.877241 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:51.877163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54" event={"ID":"fc25c004-44e4-4671-951b-c1926e084b08","Type":"ContainerStarted","Data":"4a8b8b8c36b1ec87f478297a513f2c204fc5cb2522ed1877e6afd13e5e550955"}
Jul 13 15:30:52.026982 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.026950    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"]
Jul 13 15:30:52.033957 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.033927    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"]
Jul 13 15:30:52.075103 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.075076    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"]
Jul 13 15:30:52.075313 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.075287    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" containerName="manager" containerID="cri-o://3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6" gracePeriod=2
Jul 13 15:30:52.082638 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.082572    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"]
Jul 13 15:30:52.101366 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.101340    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"]
Jul 13 15:30:52.101714 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.101701    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" containerName="manager"
Jul 13 15:30:52.101773 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.101716    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" containerName="manager"
Jul 13 15:30:52.101808 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.101783    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" containerName="manager"
Jul 13 15:30:52.106373 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.106358    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"
Jul 13 15:30:52.115694 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.115672    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"]
Jul 13 15:30:52.128771 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:52.128711    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w2rt6\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:52.131100 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.131079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4rg\" (UniqueName: \"kubernetes.io/projected/d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e-kube-api-access-wv4rg\") pod \"limitador-operator-controller-manager-859d7b78bd-db4wh\" (UID: \"d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"
Jul 13 15:30:52.232431 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.232385    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4rg\" (UniqueName: \"kubernetes.io/projected/d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e-kube-api-access-wv4rg\") pod \"limitador-operator-controller-manager-859d7b78bd-db4wh\" (UID: \"d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"
Jul 13 15:30:52.246493 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.246439    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4rg\" (UniqueName: \"kubernetes.io/projected/d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e-kube-api-access-wv4rg\") pod \"limitador-operator-controller-manager-859d7b78bd-db4wh\" (UID: \"d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"
Jul 13 15:30:52.317296 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.317252    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:52.319563 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:52.319539    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w2rt6\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:52.333822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.333801    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k72tl\" (UniqueName: \"kubernetes.io/projected/aa00d3a0-8df5-42ea-8ade-f6dc977bff36-kube-api-access-k72tl\") pod \"aa00d3a0-8df5-42ea-8ade-f6dc977bff36\" (UID: \"aa00d3a0-8df5-42ea-8ade-f6dc977bff36\") "
Jul 13 15:30:52.335894 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.335873    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa00d3a0-8df5-42ea-8ade-f6dc977bff36-kube-api-access-k72tl" (OuterVolumeSpecName: "kube-api-access-k72tl") pod "aa00d3a0-8df5-42ea-8ade-f6dc977bff36" (UID: "aa00d3a0-8df5-42ea-8ade-f6dc977bff36"). InnerVolumeSpecName "kube-api-access-k72tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:30:52.435175 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.435148    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k72tl\" (UniqueName: \"kubernetes.io/projected/aa00d3a0-8df5-42ea-8ade-f6dc977bff36-kube-api-access-k72tl\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:30:52.455021 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.454992    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"
Jul 13 15:30:52.615966 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.615947    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"]
Jul 13 15:30:52.618045 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:30:52.618018    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cf3e12_4b64_4b4d_a7e7_86d86fa2b87e.slice/crio-f5c86a72c136b0d785221a6db656573e38359e04eaa06c2661cdc1fdc76fa996 WatchSource:0}: Error finding container f5c86a72c136b0d785221a6db656573e38359e04eaa06c2661cdc1fdc76fa996: Status 404 returned error can't find the container with id f5c86a72c136b0d785221a6db656573e38359e04eaa06c2661cdc1fdc76fa996
Jul 13 15:30:52.883615 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.883577    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh" event={"ID":"d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e","Type":"ContainerStarted","Data":"e1a1a72853edb2edd9378532d4c7f043cb0df3b2b8a9f542671ab6af94e584b6"}
Jul 13 15:30:52.883817 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.883649    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"
Jul 13 15:30:52.883817 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.883678    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh" event={"ID":"d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e","Type":"ContainerStarted","Data":"f5c86a72c136b0d785221a6db656573e38359e04eaa06c2661cdc1fdc76fa996"}
Jul 13 15:30:52.885102 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.885072    2556 generic.go:356] "Generic (PLEG): container finished" podID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" containerID="3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6" exitCode=0
Jul 13 15:30:52.885102 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.885102    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:52.885249 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.885142    2556 scope.go:117] "RemoveContainer" containerID="3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6"
Jul 13 15:30:52.895622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.895599    2556 scope.go:117] "RemoveContainer" containerID="3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6"
Jul 13 15:30:52.895991 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:52.895949    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6\": container with ID starting with 3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6 not found: ID does not exist" containerID="3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6"
Jul 13 15:30:52.896078 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.895987    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6"} err="failed to get container status \"3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6\": rpc error: code = NotFound desc = could not find container \"3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6\": container with ID starting with 3c147ceb5bb0f5258c7b312437f01f092ac83212e0e460fa29fc904d2a9f55e6 not found: ID does not exist"
Jul 13 15:30:52.909437 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:52.909361    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh" podStartSLOduration=0.909342932 podStartE2EDuration="909.342932ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:52.907449443 +0000 UTC m=+406.468139932" watchObservedRunningTime="2026-07-13 15:30:52.909342932 +0000 UTC m=+406.470033419"
Jul 13 15:30:52.909569 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:52.909533    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w2rt6\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:52.911401 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:52.911368    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w2rt6\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w2rt6"
Jul 13 15:30:53.078879 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:53.078804    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa00d3a0-8df5-42ea-8ade-f6dc977bff36" path="/var/lib/kubelet/pods/aa00d3a0-8df5-42ea-8ade-f6dc977bff36/volumes"
Jul 13 15:30:56.914314 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:56.914245    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54" podUID="fc25c004-44e4-4671-951b-c1926e084b08" containerName="manager" containerID="cri-o://f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1" gracePeriod=2
Jul 13 15:30:57.151533 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.151511    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:57.284581 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.284508    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc25c004-44e4-4671-951b-c1926e084b08-extensions-socket-volume\") pod \"fc25c004-44e4-4671-951b-c1926e084b08\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") "
Jul 13 15:30:57.284718 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.284598    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z82df\" (UniqueName: \"kubernetes.io/projected/fc25c004-44e4-4671-951b-c1926e084b08-kube-api-access-z82df\") pod \"fc25c004-44e4-4671-951b-c1926e084b08\" (UID: \"fc25c004-44e4-4671-951b-c1926e084b08\") "
Jul 13 15:30:57.284718 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.284674    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc25c004-44e4-4671-951b-c1926e084b08-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc25c004-44e4-4671-951b-c1926e084b08" (UID: "fc25c004-44e4-4671-951b-c1926e084b08"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:57.284800 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.284773    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc25c004-44e4-4671-951b-c1926e084b08-extensions-socket-volume\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:30:57.286626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.286606    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc25c004-44e4-4671-951b-c1926e084b08-kube-api-access-z82df" (OuterVolumeSpecName: "kube-api-access-z82df") pod "fc25c004-44e4-4671-951b-c1926e084b08" (UID: "fc25c004-44e4-4671-951b-c1926e084b08"). InnerVolumeSpecName "kube-api-access-z82df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:30:57.385515 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.385488    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z82df\" (UniqueName: \"kubernetes.io/projected/fc25c004-44e4-4671-951b-c1926e084b08-kube-api-access-z82df\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:30:57.920013 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.919980    2556 generic.go:356] "Generic (PLEG): container finished" podID="fc25c004-44e4-4671-951b-c1926e084b08" containerID="f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1" exitCode=2
Jul 13 15:30:57.920468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.920021    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:57.920468 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.920095    2556 scope.go:117] "RemoveContainer" containerID="f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1"
Jul 13 15:30:57.922569 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:57.922542    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="fc25c004-44e4-4671-951b-c1926e084b08" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:57.928825 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.928809    2556 scope.go:117] "RemoveContainer" containerID="f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1"
Jul 13 15:30:57.929065 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:57.929037    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1\": container with ID starting with f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1 not found: ID does not exist" containerID="f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1"
Jul 13 15:30:57.929112 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:57.929075    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1"} err="failed to get container status \"f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1\": rpc error: code = NotFound desc = could not find container \"f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1\": container with ID starting with f7fa38279bde5646c5aa095bcfc92eb4c00ca1014b0da643bbac5c566cb3afd1 not found: ID does not exist"
Jul 13 15:30:57.930153 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:30:57.930135    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8jc54\" is forbidden: User \"system:node:ip-10-0-139-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-109.ec2.internal' and this object" podUID="fc25c004-44e4-4671-951b-c1926e084b08" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8jc54"
Jul 13 15:30:59.079306 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:30:59.079247    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc25c004-44e4-4671-951b-c1926e084b08" path="/var/lib/kubelet/pods/fc25c004-44e4-4671-951b-c1926e084b08/volumes"
Jul 13 15:31:03.896620 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:03.896587    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-db4wh"
Jul 13 15:31:05.675726 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.675688    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"]
Jul 13 15:31:05.676230 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.676208    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc25c004-44e4-4671-951b-c1926e084b08" containerName="manager"
Jul 13 15:31:05.676230 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.676225    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc25c004-44e4-4671-951b-c1926e084b08" containerName="manager"
Jul 13 15:31:05.676440 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.676425    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc25c004-44e4-4671-951b-c1926e084b08" containerName="manager"
Jul 13 15:31:05.679841 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.679820    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:05.682089 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.682063    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q98wm\""
Jul 13 15:31:05.689883 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.689861    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"]
Jul 13 15:31:05.761666 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.761634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95c2f\" (UniqueName: \"kubernetes.io/projected/42d1a43d-a8e3-4454-a0d8-6442375c007b-kube-api-access-95c2f\") pod \"kuadrant-operator-controller-manager-86878c769f-pvjpk\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:05.761797 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.761701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d1a43d-a8e3-4454-a0d8-6442375c007b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pvjpk\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:05.862280 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.862244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95c2f\" (UniqueName: \"kubernetes.io/projected/42d1a43d-a8e3-4454-a0d8-6442375c007b-kube-api-access-95c2f\") pod \"kuadrant-operator-controller-manager-86878c769f-pvjpk\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:05.862445 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.862332    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d1a43d-a8e3-4454-a0d8-6442375c007b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pvjpk\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:05.862648 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.862632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d1a43d-a8e3-4454-a0d8-6442375c007b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pvjpk\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:05.870719 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.870699    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95c2f\" (UniqueName: \"kubernetes.io/projected/42d1a43d-a8e3-4454-a0d8-6442375c007b-kube-api-access-95c2f\") pod \"kuadrant-operator-controller-manager-86878c769f-pvjpk\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:05.991334 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:05.991236    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:06.131686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:06.131659    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"]
Jul 13 15:31:06.134231 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:31:06.134203    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d1a43d_a8e3_4454_a0d8_6442375c007b.slice/crio-be7d62944890773622ae006d51d6f05327c2a9582ddfc8eb5cd6239129c40fe1 WatchSource:0}: Error finding container be7d62944890773622ae006d51d6f05327c2a9582ddfc8eb5cd6239129c40fe1: Status 404 returned error can't find the container with id be7d62944890773622ae006d51d6f05327c2a9582ddfc8eb5cd6239129c40fe1
Jul 13 15:31:06.962326 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:06.962292    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk" event={"ID":"42d1a43d-a8e3-4454-a0d8-6442375c007b","Type":"ContainerStarted","Data":"497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6"}
Jul 13 15:31:06.962664 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:06.962342    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk" event={"ID":"42d1a43d-a8e3-4454-a0d8-6442375c007b","Type":"ContainerStarted","Data":"be7d62944890773622ae006d51d6f05327c2a9582ddfc8eb5cd6239129c40fe1"}
Jul 13 15:31:06.962664 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:06.962375    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:31:07.026890 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:07.026835    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk" podStartSLOduration=2.02681933 podStartE2EDuration="2.02681933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:31:07.025745223 +0000 UTC m=+420.586435764" watchObservedRunningTime="2026-07-13 15:31:07.02681933 +0000 UTC m=+420.587509817"
Jul 13 15:31:17.969876 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:31:17.969845    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:33:23.141845 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.141809    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"]
Jul 13 15:33:23.144479 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.144458    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.146828 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.146807    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 15:33:23.147686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.147661    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tl4pf\""
Jul 13 15:33:23.147784 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.147699    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 15:33:23.147784 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.147758    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 15:33:23.158208 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.158182    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"]
Jul 13 15:33:23.258121 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.258094    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.258301 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.258128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.258301 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.258149    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff7e808-92c4-4947-b7c5-64b1d35f8155-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.258301 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.258173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6ch\" (UniqueName: \"kubernetes.io/projected/eff7e808-92c4-4947-b7c5-64b1d35f8155-kube-api-access-5w6ch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.258410 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.258304    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.258410 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.258340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.359860 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.359823    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.359933    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.359958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.359973    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff7e808-92c4-4947-b7c5-64b1d35f8155-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360037 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.359998    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6ch\" (UniqueName: \"kubernetes.io/projected/eff7e808-92c4-4947-b7c5-64b1d35f8155-kube-api-access-5w6ch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360243 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.360061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360325 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.360255    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360325 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.360313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.360430 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.360398    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.362248 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.362221    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff7e808-92c4-4947-b7c5-64b1d35f8155-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.362547 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.362528    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff7e808-92c4-4947-b7c5-64b1d35f8155-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.372293 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.372249    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6ch\" (UniqueName: \"kubernetes.io/projected/eff7e808-92c4-4947-b7c5-64b1d35f8155-kube-api-access-5w6ch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s\" (UID: \"eff7e808-92c4-4947-b7c5-64b1d35f8155\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.454731 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.454691    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:23.596235 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:23.596161    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"]
Jul 13 15:33:23.599011 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:33:23.598970    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff7e808_92c4_4947_b7c5_64b1d35f8155.slice/crio-3e0966fa01f5d777c892d2dceeefbcc5e69b14ee4cc9c525a4126da194b042dc WatchSource:0}: Error finding container 3e0966fa01f5d777c892d2dceeefbcc5e69b14ee4cc9c525a4126da194b042dc: Status 404 returned error can't find the container with id 3e0966fa01f5d777c892d2dceeefbcc5e69b14ee4cc9c525a4126da194b042dc
Jul 13 15:33:24.602513 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:24.602466    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s" event={"ID":"eff7e808-92c4-4947-b7c5-64b1d35f8155","Type":"ContainerStarted","Data":"3e0966fa01f5d777c892d2dceeefbcc5e69b14ee4cc9c525a4126da194b042dc"}
Jul 13 15:33:25.608569 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:25.608534    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s" event={"ID":"eff7e808-92c4-4947-b7c5-64b1d35f8155","Type":"ContainerStarted","Data":"f9b8126be1add2af1a529d896c29892b0357ddba4a514abcef3c5630e5cf0447"}
Jul 13 15:33:25.627660 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:25.627607    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s" podStartSLOduration=1.515199419 podStartE2EDuration="2.627592312s" totalImagesPullingTime="1.112392893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:33:25.626058977 +0000 UTC m=+559.186749464" watchObservedRunningTime="2026-07-13 15:33:25.627592312 +0000 UTC m=+559.188282799"
Jul 13 15:33:33.455553 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:33.455516    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:33.456030 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:33.455577    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:33.468226 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:33.468181    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:33:33.657182 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:33:33.657150    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s"
Jul 13 15:34:06.890494 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:06.890468    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:34:06.895633 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:06.895609    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:34:14.044191 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.044155    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"]
Jul 13 15:34:14.047662 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.047646    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.049948 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.049932    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 13 15:34:14.058827 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.058804    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"]
Jul 13 15:34:14.104445 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.104413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.104619 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.104535    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.104619 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.104571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.104706 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.104654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.104706 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.104691    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p6ml\" (UniqueName: \"kubernetes.io/projected/27ecd6ec-90f0-4762-a00e-8ee7836285e7-kube-api-access-2p6ml\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.104798 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.104781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ecd6ec-90f0-4762-a00e-8ee7836285e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.205658 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.205621    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.205658 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.205659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.205894 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.205694    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.205894 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.205713    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p6ml\" (UniqueName: \"kubernetes.io/projected/27ecd6ec-90f0-4762-a00e-8ee7836285e7-kube-api-access-2p6ml\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.205894 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.205762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ecd6ec-90f0-4762-a00e-8ee7836285e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.205894 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.205782    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.206096 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.206063    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.206162 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.206139    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.206225 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.206172    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.208020 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.207992    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ecd6ec-90f0-4762-a00e-8ee7836285e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.208292 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.208240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ecd6ec-90f0-4762-a00e-8ee7836285e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.216759 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.216740    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p6ml\" (UniqueName: \"kubernetes.io/projected/27ecd6ec-90f0-4762-a00e-8ee7836285e7-kube-api-access-2p6ml\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k\" (UID: \"27ecd6ec-90f0-4762-a00e-8ee7836285e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.358855 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.358777    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:14.494739 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.494716    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"]
Jul 13 15:34:14.497181 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:34:14.497153    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ecd6ec_90f0_4762_a00e_8ee7836285e7.slice/crio-ac861e89449b45f4a7a6fc79c15d8b0bfa04629b7d815b6cb013fb107d22b261 WatchSource:0}: Error finding container ac861e89449b45f4a7a6fc79c15d8b0bfa04629b7d815b6cb013fb107d22b261: Status 404 returned error can't find the container with id ac861e89449b45f4a7a6fc79c15d8b0bfa04629b7d815b6cb013fb107d22b261
Jul 13 15:34:14.836503 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.836474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k" event={"ID":"27ecd6ec-90f0-4762-a00e-8ee7836285e7","Type":"ContainerStarted","Data":"09289109d7a81b4d7f3bf2757a2d1a8f8a6c83af0b0892d89987b14b7c92454e"}
Jul 13 15:34:14.836641 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.836521    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k" event={"ID":"27ecd6ec-90f0-4762-a00e-8ee7836285e7","Type":"ContainerStarted","Data":"ac861e89449b45f4a7a6fc79c15d8b0bfa04629b7d815b6cb013fb107d22b261"}
Jul 13 15:34:14.857514 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:14.857462    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k" podStartSLOduration=0.659550023 podStartE2EDuration="857.44705ms" totalImagesPullingTime="197.897027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:34:14.856791941 +0000 UTC m=+608.417482430" watchObservedRunningTime="2026-07-13 15:34:14.85744705 +0000 UTC m=+608.418137536"
Jul 13 15:34:24.359381 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:24.359342    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:24.359852 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:24.359406    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:24.371747 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:24.371720    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:34:24.896744 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:34:24.896710    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k"
Jul 13 15:39:06.920312 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:39:06.920213    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:39:06.925961 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:39:06.925936    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:42:15.041042 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:15.040997    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"]
Jul 13 15:42:15.041539 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:15.041220    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk" podUID="42d1a43d-a8e3-4454-a0d8-6442375c007b" containerName="manager" containerID="cri-o://497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6" gracePeriod=10
Jul 13 15:42:16.692025 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:16.692002    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:42:16.739616 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:16.739549    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d1a43d-a8e3-4454-a0d8-6442375c007b-extensions-socket-volume\") pod \"42d1a43d-a8e3-4454-a0d8-6442375c007b\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") "
Jul 13 15:42:16.739747 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:16.739634    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95c2f\" (UniqueName: \"kubernetes.io/projected/42d1a43d-a8e3-4454-a0d8-6442375c007b-kube-api-access-95c2f\") pod \"42d1a43d-a8e3-4454-a0d8-6442375c007b\" (UID: \"42d1a43d-a8e3-4454-a0d8-6442375c007b\") "
Jul 13 15:42:16.739889 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:16.739866    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d1a43d-a8e3-4454-a0d8-6442375c007b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42d1a43d-a8e3-4454-a0d8-6442375c007b" (UID: "42d1a43d-a8e3-4454-a0d8-6442375c007b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:42:16.739983 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:16.739968    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d1a43d-a8e3-4454-a0d8-6442375c007b-extensions-socket-volume\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:42:16.741744 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:16.741711    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d1a43d-a8e3-4454-a0d8-6442375c007b-kube-api-access-95c2f" (OuterVolumeSpecName: "kube-api-access-95c2f") pod "42d1a43d-a8e3-4454-a0d8-6442375c007b" (UID: "42d1a43d-a8e3-4454-a0d8-6442375c007b"). InnerVolumeSpecName "kube-api-access-95c2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:42:16.841049 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:16.841015    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95c2f\" (UniqueName: \"kubernetes.io/projected/42d1a43d-a8e3-4454-a0d8-6442375c007b-kube-api-access-95c2f\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:42:17.134770 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.134736    2556 generic.go:356] "Generic (PLEG): container finished" podID="42d1a43d-a8e3-4454-a0d8-6442375c007b" containerID="497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6" exitCode=0
Jul 13 15:42:17.134936 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.134787    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"
Jul 13 15:42:17.134936 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.134786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk" event={"ID":"42d1a43d-a8e3-4454-a0d8-6442375c007b","Type":"ContainerDied","Data":"497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6"}
Jul 13 15:42:17.134936 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.134852    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk" event={"ID":"42d1a43d-a8e3-4454-a0d8-6442375c007b","Type":"ContainerDied","Data":"be7d62944890773622ae006d51d6f05327c2a9582ddfc8eb5cd6239129c40fe1"}
Jul 13 15:42:17.134936 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.134882    2556 scope.go:117] "RemoveContainer" containerID="497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6"
Jul 13 15:42:17.144305 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.144289    2556 scope.go:117] "RemoveContainer" containerID="497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6"
Jul 13 15:42:17.144570 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:42:17.144553    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6\": container with ID starting with 497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6 not found: ID does not exist" containerID="497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6"
Jul 13 15:42:17.144622 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.144579    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6"} err="failed to get container status \"497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6\": rpc error: code = NotFound desc = could not find container \"497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6\": container with ID starting with 497d366c41c0894d19992bd840406027fca6815cb06f1eb338fc419e88060fe6 not found: ID does not exist"
Jul 13 15:42:17.154060 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.154036    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"]
Jul 13 15:42:17.158738 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:17.158717    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pvjpk"]
Jul 13 15:42:19.079595 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:42:19.079564    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d1a43d-a8e3-4454-a0d8-6442375c007b" path="/var/lib/kubelet/pods/42d1a43d-a8e3-4454-a0d8-6442375c007b/volumes"
Jul 13 15:43:16.229582 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.229548    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"]
Jul 13 15:43:16.230109 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.230089    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d1a43d-a8e3-4454-a0d8-6442375c007b" containerName="manager"
Jul 13 15:43:16.230190 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.230111    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d1a43d-a8e3-4454-a0d8-6442375c007b" containerName="manager"
Jul 13 15:43:16.230253 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.230239    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d1a43d-a8e3-4454-a0d8-6442375c007b" containerName="manager"
Jul 13 15:43:16.234614 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.234593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.237178 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.237153    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q98wm\""
Jul 13 15:43:16.243607 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.243582    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"]
Jul 13 15:43:16.357895 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.357861    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e318a6ea-06b4-4668-8940-0f542a36e2fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mtn4d\" (UID: \"e318a6ea-06b4-4668-8940-0f542a36e2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.357895 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.357898    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2pp\" (UniqueName: \"kubernetes.io/projected/e318a6ea-06b4-4668-8940-0f542a36e2fc-kube-api-access-zp2pp\") pod \"kuadrant-operator-controller-manager-86878c769f-mtn4d\" (UID: \"e318a6ea-06b4-4668-8940-0f542a36e2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.458538 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.458509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e318a6ea-06b4-4668-8940-0f542a36e2fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mtn4d\" (UID: \"e318a6ea-06b4-4668-8940-0f542a36e2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.458704 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.458544    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2pp\" (UniqueName: \"kubernetes.io/projected/e318a6ea-06b4-4668-8940-0f542a36e2fc-kube-api-access-zp2pp\") pod \"kuadrant-operator-controller-manager-86878c769f-mtn4d\" (UID: \"e318a6ea-06b4-4668-8940-0f542a36e2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.458879 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.458859    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e318a6ea-06b4-4668-8940-0f542a36e2fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mtn4d\" (UID: \"e318a6ea-06b4-4668-8940-0f542a36e2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.466754 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.466730    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2pp\" (UniqueName: \"kubernetes.io/projected/e318a6ea-06b4-4668-8940-0f542a36e2fc-kube-api-access-zp2pp\") pod \"kuadrant-operator-controller-manager-86878c769f-mtn4d\" (UID: \"e318a6ea-06b4-4668-8940-0f542a36e2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.545764 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.545689    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:16.698665 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:16.698635    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"]
Jul 13 15:43:16.701889 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:43:16.701868    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode318a6ea_06b4_4668_8940_0f542a36e2fc.slice/crio-5040fda66eb678f1a62d39194fca80064b64b469a6eaba6acef9ac3aa01ff496 WatchSource:0}: Error finding container 5040fda66eb678f1a62d39194fca80064b64b469a6eaba6acef9ac3aa01ff496: Status 404 returned error can't find the container with id 5040fda66eb678f1a62d39194fca80064b64b469a6eaba6acef9ac3aa01ff496
Jul 13 15:43:17.420044 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:17.420010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d" event={"ID":"e318a6ea-06b4-4668-8940-0f542a36e2fc","Type":"ContainerStarted","Data":"72b9e0a08dba17645c7b173bce0003d40d0909ecdf99055ba07c7222a4abd75f"}
Jul 13 15:43:17.420434 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:17.420059    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d" event={"ID":"e318a6ea-06b4-4668-8940-0f542a36e2fc","Type":"ContainerStarted","Data":"5040fda66eb678f1a62d39194fca80064b64b469a6eaba6acef9ac3aa01ff496"}
Jul 13 15:43:17.420434 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:17.420137    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:43:17.444035 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:17.443992    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d" podStartSLOduration=1.443977182 podStartE2EDuration="1.443977182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:43:17.441733668 +0000 UTC m=+1151.002424156" watchObservedRunningTime="2026-07-13 15:43:17.443977182 +0000 UTC m=+1151.004667668"
Jul 13 15:43:28.427370 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:43:28.427299    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtn4d"
Jul 13 15:44:06.960693 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:44:06.960663    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:44:06.961627 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:44:06.961601    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:49:06.992844 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:06.992812    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:49:06.993806 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:06.993787    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:49:42.719917 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.719885    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"]
Jul 13 15:49:42.723613 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.723596    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"
Jul 13 15:49:42.726252 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.726230    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:49:42.726383 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.726329    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:49:42.732128 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.732096    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"]
Jul 13 15:49:42.866490 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.866452    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/521dab98-5b26-42ea-a724-6b3459b9e2c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-70631383-kmmw5\" (UID: \"521dab98-5b26-42ea-a724-6b3459b9e2c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"
Jul 13 15:49:42.967662 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.967628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/521dab98-5b26-42ea-a724-6b3459b9e2c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-70631383-kmmw5\" (UID: \"521dab98-5b26-42ea-a724-6b3459b9e2c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"
Jul 13 15:49:42.968313 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:42.968256    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/521dab98-5b26-42ea-a724-6b3459b9e2c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-70631383-kmmw5\" (UID: \"521dab98-5b26-42ea-a724-6b3459b9e2c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"
Jul 13 15:49:43.035711 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:43.035636    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"
Jul 13 15:49:43.172034 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:43.172013    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"]
Jul 13 15:49:43.174323 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:49:43.174295    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521dab98_5b26_42ea_a724_6b3459b9e2c9.slice/crio-e3ba8615d836b5b49caf627c6d9e64bb9e6f9b212b89f180cb6f9222aa44b2c9 WatchSource:0}: Error finding container e3ba8615d836b5b49caf627c6d9e64bb9e6f9b212b89f180cb6f9222aa44b2c9: Status 404 returned error can't find the container with id e3ba8615d836b5b49caf627c6d9e64bb9e6f9b212b89f180cb6f9222aa44b2c9
Jul 13 15:49:43.176567 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:43.176549    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:49:43.266944 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:43.266913    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5" event={"ID":"521dab98-5b26-42ea-a724-6b3459b9e2c9","Type":"ContainerStarted","Data":"e3ba8615d836b5b49caf627c6d9e64bb9e6f9b212b89f180cb6f9222aa44b2c9"}
Jul 13 15:49:46.288181 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:46.288142    2556 generic.go:356] "Generic (PLEG): container finished" podID="521dab98-5b26-42ea-a724-6b3459b9e2c9" containerID="d16641b8c21072d8e7faf0560aefc10a9696846fed9c74fb71abcf340451a676" exitCode=0
Jul 13 15:49:46.288667 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:46.288229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5" event={"ID":"521dab98-5b26-42ea-a724-6b3459b9e2c9","Type":"ContainerDied","Data":"d16641b8c21072d8e7faf0560aefc10a9696846fed9c74fb71abcf340451a676"}
Jul 13 15:49:47.430947 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:47.430923    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"
Jul 13 15:49:47.614619 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:47.614525    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/521dab98-5b26-42ea-a724-6b3459b9e2c9-maas-api-service-ca\") pod \"521dab98-5b26-42ea-a724-6b3459b9e2c9\" (UID: \"521dab98-5b26-42ea-a724-6b3459b9e2c9\") "
Jul 13 15:49:47.614893 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:47.614870    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521dab98-5b26-42ea-a724-6b3459b9e2c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "521dab98-5b26-42ea-a724-6b3459b9e2c9" (UID: "521dab98-5b26-42ea-a724-6b3459b9e2c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:49:47.716044 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:47.716004    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/521dab98-5b26-42ea-a724-6b3459b9e2c9-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:49:48.298668 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:48.298635    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5" event={"ID":"521dab98-5b26-42ea-a724-6b3459b9e2c9","Type":"ContainerDied","Data":"e3ba8615d836b5b49caf627c6d9e64bb9e6f9b212b89f180cb6f9222aa44b2c9"}
Jul 13 15:49:48.298668 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:48.298652    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-70631383-kmmw5"
Jul 13 15:49:48.298863 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:49:48.298684    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3ba8615d836b5b49caf627c6d9e64bb9e6f9b212b89f180cb6f9222aa44b2c9"
Jul 13 15:50:08.772700 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.772661    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"]
Jul 13 15:50:08.773339 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.773318    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="521dab98-5b26-42ea-a724-6b3459b9e2c9" containerName="revoke-keys"
Jul 13 15:50:08.773438 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.773342    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="521dab98-5b26-42ea-a724-6b3459b9e2c9" containerName="revoke-keys"
Jul 13 15:50:08.773489 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.773457    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="521dab98-5b26-42ea-a724-6b3459b9e2c9" containerName="revoke-keys"
Jul 13 15:50:08.777173 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.777145    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.780180 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.780153    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e90cca64-gw-openshift-default-dockercfg-6qzd7\""
Jul 13 15:50:08.790243 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.790216    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"]
Jul 13 15:50:08.891117 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcrn\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-kube-api-access-9pcrn\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891117 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-credential-socket\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891405 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-certs\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891405 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-token\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891405 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891335    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-podinfo\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891405 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-socket\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891608 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891439    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-envoy\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891608 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891473    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-data\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.891608 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.891534    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaaf6190-151b-4609-9d53-c0fa4763edc2-istiod-ca-cert\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.992635 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992605    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-credential-socket\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.992792 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992642    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-certs\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.992792 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-token\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.992792 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-podinfo\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.992792 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992733    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-socket\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.992792 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992761    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-envoy\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993032 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-data\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993032 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaaf6190-151b-4609-9d53-c0fa4763edc2-istiod-ca-cert\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993032 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.992869    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcrn\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-kube-api-access-9pcrn\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993203 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.993089    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-certs\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993307 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.993248    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-socket\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993367 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.993299    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-data\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993402 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.993372    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-credential-socket\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.993597 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.993579    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaaf6190-151b-4609-9d53-c0fa4763edc2-istiod-ca-cert\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.995057 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.995034    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-envoy\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:08.995286 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:08.995251    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-podinfo\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:09.000695 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.000672    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcrn\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-kube-api-access-9pcrn\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:09.000805 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.000697    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-token\") pod \"e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") " pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:09.089192 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.089107    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:09.231875 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.231847    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"]
Jul 13 15:50:09.234447 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:50:09.234421    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaaf6190_151b_4609_9d53_c0fa4763edc2.slice/crio-d484f20f079d28375a248e5f8cf15e2e75cda162715c4d56405e78b61b52a194 WatchSource:0}: Error finding container d484f20f079d28375a248e5f8cf15e2e75cda162715c4d56405e78b61b52a194: Status 404 returned error can't find the container with id d484f20f079d28375a248e5f8cf15e2e75cda162715c4d56405e78b61b52a194
Jul 13 15:50:09.236699 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.236662    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:50:09.236769 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.236750    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:50:09.236822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.236807    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:50:09.407059 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.407016    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" event={"ID":"aaaf6190-151b-4609-9d53-c0fa4763edc2","Type":"ContainerStarted","Data":"f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957"}
Jul 13 15:50:09.407206 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.407082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" event={"ID":"aaaf6190-151b-4609-9d53-c0fa4763edc2","Type":"ContainerStarted","Data":"d484f20f079d28375a248e5f8cf15e2e75cda162715c4d56405e78b61b52a194"}
Jul 13 15:50:09.428558 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:09.428510    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podStartSLOduration=1.428494057 podStartE2EDuration="1.428494057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:50:09.42674738 +0000 UTC m=+1562.987437867" watchObservedRunningTime="2026-07-13 15:50:09.428494057 +0000 UTC m=+1562.989184544"
Jul 13 15:50:10.090187 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:10.090150    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:10.095360 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:10.095334    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:10.412160 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:10.412136    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:10.413187 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:10.413170    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:26.453460 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:26.453415    2556 patch_prober.go:28] interesting pod/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 15:50:26.463620 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:26.453507    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 15:50:27.499668 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:27.499632    2556 generic.go:356] "Generic (PLEG): container finished" podID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerID="f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957" exitCode=0
Jul 13 15:50:27.500206 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:27.499704    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" event={"ID":"aaaf6190-151b-4609-9d53-c0fa4763edc2","Type":"ContainerDied","Data":"f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957"}
Jul 13 15:50:27.500206 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:27.500105    2556 scope.go:117] "RemoveContainer" containerID="f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957"
Jul 13 15:50:27.501175 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:27.501148    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:50:27.501297 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:27.501211    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:50:27.501297 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:27.501245    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:50:28.507585 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:28.507554    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" event={"ID":"aaaf6190-151b-4609-9d53-c0fa4763edc2","Type":"ContainerStarted","Data":"6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06"}
Jul 13 15:50:29.090524 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:29.090483    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:29.090749 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:29.090614    2556 patch_prober.go:28] interesting pod/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 13 15:50:29.090749 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:29.090657    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 13 15:50:30.090965 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:30.090520    2556 patch_prober.go:28] interesting pod/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 13 15:50:30.090965 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:30.090589    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 13 15:50:31.089945 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:31.089497    2556 patch_prober.go:28] interesting pod/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 13 15:50:31.089945 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:31.089573    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 13 15:50:32.089909 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:32.089867    2556 patch_prober.go:28] interesting pod/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 13 15:50:32.090534 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:32.090497    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 13 15:50:33.093435 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:33.093408    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:33.093797 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:33.093780    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:50:33.094393 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:50:33.094377    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:51:14.733813 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:14.733777    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"]
Jul 13 15:51:14.734393 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:14.734049    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy" containerID="cri-o://6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06" gracePeriod=30
Jul 13 15:51:18.095956 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:18.095917    2556 patch_prober.go:28] interesting pod/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 15:51:18.096388 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:18.095993    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:51:19.985984 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:19.985960    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:51:20.049866 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.049796    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-envoy\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.049866 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.049831    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-token\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.049866 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.049848    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-podinfo\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.050112 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.049883    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-credential-socket\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.050112 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.049906    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaaf6190-151b-4609-9d53-c0fa4763edc2-istiod-ca-cert\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.050112 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.049944    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-certs\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.050112 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.050013    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pcrn\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-kube-api-access-9pcrn\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.050112 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.050039    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-socket\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.050112 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.050077    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-data\") pod \"aaaf6190-151b-4609-9d53-c0fa4763edc2\" (UID: \"aaaf6190-151b-4609-9d53-c0fa4763edc2\") "
Jul 13 15:51:20.050768 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.050492    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:51:20.050768 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.050608    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:51:20.050768 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.050700    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:51:20.050768 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.050755    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaaf6190-151b-4609-9d53-c0fa4763edc2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:51:20.051338 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.051313    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-data" (OuterVolumeSpecName: "istio-data") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:51:20.052441 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.052405    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-token" (OuterVolumeSpecName: "istio-token") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:51:20.052569 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.052537    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:51:20.052880 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.052667    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-kube-api-access-9pcrn" (OuterVolumeSpecName: "kube-api-access-9pcrn") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "kube-api-access-9pcrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:51:20.053125 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.053099    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aaaf6190-151b-4609-9d53-c0fa4763edc2" (UID: "aaaf6190-151b-4609-9d53-c0fa4763edc2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 15:51:20.151414 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151382    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-data\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151414 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151408    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-envoy\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151414 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151418    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-token\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151425    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaaf6190-151b-4609-9d53-c0fa4763edc2-istio-podinfo\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151435    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-credential-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151443    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaaf6190-151b-4609-9d53-c0fa4763edc2-istiod-ca-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151453    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-certs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151462    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pcrn\" (UniqueName: \"kubernetes.io/projected/aaaf6190-151b-4609-9d53-c0fa4763edc2-kube-api-access-9pcrn\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.151686 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.151470    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaaf6190-151b-4609-9d53-c0fa4763edc2-workload-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:20.768997 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.768961    2556 generic.go:356] "Generic (PLEG): container finished" podID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerID="6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06" exitCode=0
Jul 13 15:51:20.769246 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.769018    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"
Jul 13 15:51:20.769246 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.769046    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" event={"ID":"aaaf6190-151b-4609-9d53-c0fa4763edc2","Type":"ContainerDied","Data":"6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06"}
Jul 13 15:51:20.769246 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.769122    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h" event={"ID":"aaaf6190-151b-4609-9d53-c0fa4763edc2","Type":"ContainerDied","Data":"d484f20f079d28375a248e5f8cf15e2e75cda162715c4d56405e78b61b52a194"}
Jul 13 15:51:20.769990 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.769146    2556 scope.go:117] "RemoveContainer" containerID="6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06"
Jul 13 15:51:20.779397 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.779379    2556 scope.go:117] "RemoveContainer" containerID="f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957"
Jul 13 15:51:20.787364 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.787342    2556 scope.go:117] "RemoveContainer" containerID="6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06"
Jul 13 15:51:20.787609 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:51:20.787590    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06\": container with ID starting with 6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06 not found: ID does not exist" containerID="6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06"
Jul 13 15:51:20.787697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.787612    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06"} err="failed to get container status \"6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06\": rpc error: code = NotFound desc = could not find container \"6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06\": container with ID starting with 6a9bfa19edd7514640aa370b9121c84ebd3b79582e5c2979ca5d736b43758f06 not found: ID does not exist"
Jul 13 15:51:20.787697 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.787628    2556 scope.go:117] "RemoveContainer" containerID="f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957"
Jul 13 15:51:20.788083 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:51:20.787917    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957\": container with ID starting with f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957 not found: ID does not exist" containerID="f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957"
Jul 13 15:51:20.788083 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.787939    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957"} err="failed to get container status \"f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957\": rpc error: code = NotFound desc = could not find container \"f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957\": container with ID starting with f7b89ad93f3035142af917533b8c9573c61c201c2e718d6d4475639176f8a957 not found: ID does not exist"
Jul 13 15:51:20.790568 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.790546    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"]
Jul 13 15:51:20.794174 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:20.794153    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e90cca64-gw-openshift-default-69c7ccf9dc-sfb8h"]
Jul 13 15:51:21.081282 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:21.081233    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" path="/var/lib/kubelet/pods/aaaf6190-151b-4609-9d53-c0fa4763edc2/volumes"
Jul 13 15:51:27.371224 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.371195    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"]
Jul 13 15:51:27.371599 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.371581    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy"
Jul 13 15:51:27.371599 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.371594    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy"
Jul 13 15:51:27.371668 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.371603    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy"
Jul 13 15:51:27.371668 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.371609    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy"
Jul 13 15:51:27.371729 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.371673    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy"
Jul 13 15:51:27.371729 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.371682    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaaf6190-151b-4609-9d53-c0fa4763edc2" containerName="istio-proxy"
Jul 13 15:51:27.376411 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.376391    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"
Jul 13 15:51:27.379694 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.379375    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:51:27.379694 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.379519    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:51:27.381276 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.381239    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"]
Jul 13 15:51:27.413232 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.413206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/817f44b3-9cbb-4d7f-ba47-a381e7f95aec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w\" (UID: \"817f44b3-9cbb-4d7f-ba47-a381e7f95aec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"
Jul 13 15:51:27.514150 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.514119    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/817f44b3-9cbb-4d7f-ba47-a381e7f95aec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w\" (UID: \"817f44b3-9cbb-4d7f-ba47-a381e7f95aec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"
Jul 13 15:51:27.514750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.514732    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/817f44b3-9cbb-4d7f-ba47-a381e7f95aec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w\" (UID: \"817f44b3-9cbb-4d7f-ba47-a381e7f95aec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"
Jul 13 15:51:27.689863 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.689823    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"
Jul 13 15:51:27.820364 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:27.820316    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"]
Jul 13 15:51:27.822546 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:51:27.822519    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817f44b3_9cbb_4d7f_ba47_a381e7f95aec.slice/crio-a4a54e656aa53cdeb99341f96760b9bef0d8e7f69339784b1ba9dc7b1679ae1d WatchSource:0}: Error finding container a4a54e656aa53cdeb99341f96760b9bef0d8e7f69339784b1ba9dc7b1679ae1d: Status 404 returned error can't find the container with id a4a54e656aa53cdeb99341f96760b9bef0d8e7f69339784b1ba9dc7b1679ae1d
Jul 13 15:51:28.813700 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:28.813610    2556 generic.go:356] "Generic (PLEG): container finished" podID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerID="ca4b97e4067976e31d02acb1646f0d1b0349871b88f81f1be171a145a2b95a0d" exitCode=7
Jul 13 15:51:28.813700 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:28.813685    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w" event={"ID":"817f44b3-9cbb-4d7f-ba47-a381e7f95aec","Type":"ContainerDied","Data":"ca4b97e4067976e31d02acb1646f0d1b0349871b88f81f1be171a145a2b95a0d"}
Jul 13 15:51:28.814118 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:28.813734    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w" event={"ID":"817f44b3-9cbb-4d7f-ba47-a381e7f95aec","Type":"ContainerStarted","Data":"a4a54e656aa53cdeb99341f96760b9bef0d8e7f69339784b1ba9dc7b1679ae1d"}
Jul 13 15:51:28.814118 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:28.813944    2556 scope.go:117] "RemoveContainer" containerID="ca4b97e4067976e31d02acb1646f0d1b0349871b88f81f1be171a145a2b95a0d"
Jul 13 15:51:29.820379 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:29.820343    2556 generic.go:356] "Generic (PLEG): container finished" podID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerID="f9a7df0a1b4cf143e9939608cb2777a19f9127ae617d41735e72dffbd9abab1f" exitCode=7
Jul 13 15:51:29.820765 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:29.820427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w" event={"ID":"817f44b3-9cbb-4d7f-ba47-a381e7f95aec","Type":"ContainerDied","Data":"f9a7df0a1b4cf143e9939608cb2777a19f9127ae617d41735e72dffbd9abab1f"}
Jul 13 15:51:29.820765 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:29.820491    2556 scope.go:117] "RemoveContainer" containerID="ca4b97e4067976e31d02acb1646f0d1b0349871b88f81f1be171a145a2b95a0d"
Jul 13 15:51:29.820765 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:29.820644    2556 scope.go:117] "RemoveContainer" containerID="f9a7df0a1b4cf143e9939608cb2777a19f9127ae617d41735e72dffbd9abab1f"
Jul 13 15:51:29.820918 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:51:29.820897    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w_odh-ai-gateway-infra(817f44b3-9cbb-4d7f-ba47-a381e7f95aec)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec"
Jul 13 15:51:30.826585 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:30.826555    2556 scope.go:117] "RemoveContainer" containerID="f9a7df0a1b4cf143e9939608cb2777a19f9127ae617d41735e72dffbd9abab1f"
Jul 13 15:51:30.826950 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:51:30.826768    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w_odh-ai-gateway-infra(817f44b3-9cbb-4d7f-ba47-a381e7f95aec)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec"
Jul 13 15:51:44.073734 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:44.073692    2556 scope.go:117] "RemoveContainer" containerID="f9a7df0a1b4cf143e9939608cb2777a19f9127ae617d41735e72dffbd9abab1f"
Jul 13 15:51:44.895047 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:44.895013    2556 generic.go:356] "Generic (PLEG): container finished" podID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerID="f5b91b8076e8c4ba7df0d7862caa4fefd0c2b8baba3efd03e980e04573f74496" exitCode=0
Jul 13 15:51:44.895201 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:44.895080    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w" event={"ID":"817f44b3-9cbb-4d7f-ba47-a381e7f95aec","Type":"ContainerDied","Data":"f5b91b8076e8c4ba7df0d7862caa4fefd0c2b8baba3efd03e980e04573f74496"}
Jul 13 15:51:44.895201 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:44.895138    2556 scope.go:117] "RemoveContainer" containerID="f9a7df0a1b4cf143e9939608cb2777a19f9127ae617d41735e72dffbd9abab1f"
Jul 13 15:51:45.923026 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:45.922993    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"]
Jul 13 15:51:46.035498 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.035476    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"
Jul 13 15:51:46.181511 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.181434    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/817f44b3-9cbb-4d7f-ba47-a381e7f95aec-maas-api-service-ca\") pod \"817f44b3-9cbb-4d7f-ba47-a381e7f95aec\" (UID: \"817f44b3-9cbb-4d7f-ba47-a381e7f95aec\") "
Jul 13 15:51:46.181782 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.181757    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/817f44b3-9cbb-4d7f-ba47-a381e7f95aec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "817f44b3-9cbb-4d7f-ba47-a381e7f95aec" (UID: "817f44b3-9cbb-4d7f-ba47-a381e7f95aec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:51:46.283051 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.283019    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/817f44b3-9cbb-4d7f-ba47-a381e7f95aec-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:51:46.915570 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.915540    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"
Jul 13 15:51:46.915758 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.915585    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w" event={"ID":"817f44b3-9cbb-4d7f-ba47-a381e7f95aec","Type":"ContainerDied","Data":"a4a54e656aa53cdeb99341f96760b9bef0d8e7f69339784b1ba9dc7b1679ae1d"}
Jul 13 15:51:46.915758 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.915668    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4a54e656aa53cdeb99341f96760b9bef0d8e7f69339784b1ba9dc7b1679ae1d"
Jul 13 15:51:46.942508 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.942479    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"]
Jul 13 15:51:46.947977 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:46.947950    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-qpt4w"]
Jul 13 15:51:47.079276 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:51:47.079230    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" path="/var/lib/kubelet/pods/817f44b3-9cbb-4d7f-ba47-a381e7f95aec/volumes"
Jul 13 15:52:17.413173 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413128    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"]
Jul 13 15:52:17.413741 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413724    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.413789 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413745    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.413789 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413761    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.413789 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413769    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.413789 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413781    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.413789 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413789    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.413964 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413872    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.413964 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.413882    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:17.417197 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.417181    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"
Jul 13 15:52:17.419479 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.419460    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:52:17.419592 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.419511    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:52:17.422500 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.422477    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"]
Jul 13 15:52:17.460857 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.460827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v\" (UID: \"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"
Jul 13 15:52:17.561327 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.561282    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v\" (UID: \"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"
Jul 13 15:52:17.561890 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.561869    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v\" (UID: \"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"
Jul 13 15:52:17.730719 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.730630    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"
Jul 13 15:52:17.862608 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:17.862581    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"]
Jul 13 15:52:17.866236 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:52:17.866204    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8b28b5_b053_4976_ae1a_1cd4ecf7f3c2.slice/crio-765d76ca27a696cbebaea403ce5b9a1f2e7cb6bfea2d2f3851a843639e9437d2 WatchSource:0}: Error finding container 765d76ca27a696cbebaea403ce5b9a1f2e7cb6bfea2d2f3851a843639e9437d2: Status 404 returned error can't find the container with id 765d76ca27a696cbebaea403ce5b9a1f2e7cb6bfea2d2f3851a843639e9437d2
Jul 13 15:52:18.064911 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:18.064875    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v" event={"ID":"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2","Type":"ContainerStarted","Data":"765d76ca27a696cbebaea403ce5b9a1f2e7cb6bfea2d2f3851a843639e9437d2"}
Jul 13 15:52:19.071191 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:19.071153    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2" containerID="7cb33bc8abfd014cf93f6779068ac0ff7c8cc6650e7c0696f7df714972bf2c09" exitCode=0
Jul 13 15:52:19.071626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:19.071228    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v" event={"ID":"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2","Type":"ContainerDied","Data":"7cb33bc8abfd014cf93f6779068ac0ff7c8cc6650e7c0696f7df714972bf2c09"}
Jul 13 15:52:20.207209 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:20.207183    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"
Jul 13 15:52:20.286552 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:20.286518    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2-maas-api-service-ca\") pod \"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2\" (UID: \"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2\") "
Jul 13 15:52:20.286864 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:20.286842    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2" (UID: "1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:52:20.387997 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:20.387917    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:52:21.082109 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:21.082084    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v"
Jul 13 15:52:21.082286 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:21.082097    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v" event={"ID":"1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2","Type":"ContainerDied","Data":"765d76ca27a696cbebaea403ce5b9a1f2e7cb6bfea2d2f3851a843639e9437d2"}
Jul 13 15:52:21.082286 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:21.082154    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765d76ca27a696cbebaea403ce5b9a1f2e7cb6bfea2d2f3851a843639e9437d2"
Jul 13 15:52:49.427476 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.427444    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"]
Jul 13 15:52:49.427899 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.427850    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2" containerName="revoke-keys"
Jul 13 15:52:49.427899 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.427862    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2" containerName="revoke-keys"
Jul 13 15:52:49.427973 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.427923    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2" containerName="revoke-keys"
Jul 13 15:52:49.427973 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.427932    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="817f44b3-9cbb-4d7f-ba47-a381e7f95aec" containerName="revoke-keys"
Jul 13 15:52:49.430971 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.430952    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"
Jul 13 15:52:49.433060 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.433029    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:52:49.433164 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.433134    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:52:49.437297 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.437276    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"]
Jul 13 15:52:49.456105 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.456080    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baeefcf3-9043-41a8-ade0-9530b21acaff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k\" (UID: \"baeefcf3-9043-41a8-ade0-9530b21acaff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"
Jul 13 15:52:49.557401 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.557370    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baeefcf3-9043-41a8-ade0-9530b21acaff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k\" (UID: \"baeefcf3-9043-41a8-ade0-9530b21acaff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"
Jul 13 15:52:49.557961 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.557943    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baeefcf3-9043-41a8-ade0-9530b21acaff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k\" (UID: \"baeefcf3-9043-41a8-ade0-9530b21acaff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"
Jul 13 15:52:49.743533 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.743454    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"
Jul 13 15:52:49.873562 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:49.873537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"]
Jul 13 15:52:49.876382 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:52:49.876351    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaeefcf3_9043_41a8_ade0_9530b21acaff.slice/crio-f6d49c4b3ae52d7e3b70bf4c610eeddb3bdff45e356724dc52f603aa58655271 WatchSource:0}: Error finding container f6d49c4b3ae52d7e3b70bf4c610eeddb3bdff45e356724dc52f603aa58655271: Status 404 returned error can't find the container with id f6d49c4b3ae52d7e3b70bf4c610eeddb3bdff45e356724dc52f603aa58655271
Jul 13 15:52:50.224739 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:50.224707    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k" event={"ID":"baeefcf3-9043-41a8-ade0-9530b21acaff","Type":"ContainerStarted","Data":"f6d49c4b3ae52d7e3b70bf4c610eeddb3bdff45e356724dc52f603aa58655271"}
Jul 13 15:52:51.231865 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:51.231828    2556 generic.go:356] "Generic (PLEG): container finished" podID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerID="75588f911e58f15f12caccd9d6a59d5367ec85c449b73e12b0f7b722bd0b5035" exitCode=7
Jul 13 15:52:51.232241 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:51.231916    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k" event={"ID":"baeefcf3-9043-41a8-ade0-9530b21acaff","Type":"ContainerDied","Data":"75588f911e58f15f12caccd9d6a59d5367ec85c449b73e12b0f7b722bd0b5035"}
Jul 13 15:52:51.232241 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:51.232074    2556 scope.go:117] "RemoveContainer" containerID="75588f911e58f15f12caccd9d6a59d5367ec85c449b73e12b0f7b722bd0b5035"
Jul 13 15:52:52.238656 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:52.238618    2556 generic.go:356] "Generic (PLEG): container finished" podID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerID="515ff800c12c7ca74bd4f97f8f6111fa8fda2fc8e9f9dbe0e19ad8e4ac8b063d" exitCode=7
Jul 13 15:52:52.239062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:52.238698    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k" event={"ID":"baeefcf3-9043-41a8-ade0-9530b21acaff","Type":"ContainerDied","Data":"515ff800c12c7ca74bd4f97f8f6111fa8fda2fc8e9f9dbe0e19ad8e4ac8b063d"}
Jul 13 15:52:52.239062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:52.238756    2556 scope.go:117] "RemoveContainer" containerID="75588f911e58f15f12caccd9d6a59d5367ec85c449b73e12b0f7b722bd0b5035"
Jul 13 15:52:52.239062 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:52.238902    2556 scope.go:117] "RemoveContainer" containerID="515ff800c12c7ca74bd4f97f8f6111fa8fda2fc8e9f9dbe0e19ad8e4ac8b063d"
Jul 13 15:52:52.239211 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:52:52.239130    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k_odh-ai-gateway-infra(baeefcf3-9043-41a8-ade0-9530b21acaff)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff"
Jul 13 15:52:53.251048 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:52:53.251018    2556 scope.go:117] "RemoveContainer" containerID="515ff800c12c7ca74bd4f97f8f6111fa8fda2fc8e9f9dbe0e19ad8e4ac8b063d"
Jul 13 15:52:53.251430 ip-10-0-139-109 kubenswrapper[2556]: E0713 15:52:53.251218    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k_odh-ai-gateway-infra(baeefcf3-9043-41a8-ade0-9530b21acaff)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff"
Jul 13 15:53:04.072862 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:04.072832    2556 scope.go:117] "RemoveContainer" containerID="515ff800c12c7ca74bd4f97f8f6111fa8fda2fc8e9f9dbe0e19ad8e4ac8b063d"
Jul 13 15:53:05.308224 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:05.308194    2556 generic.go:356] "Generic (PLEG): container finished" podID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerID="9ee21a352fe906df376bc848518d5cb5eea4444f6b954dad5c898a66633bd060" exitCode=0
Jul 13 15:53:05.308706 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:05.308233    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k" event={"ID":"baeefcf3-9043-41a8-ade0-9530b21acaff","Type":"ContainerDied","Data":"9ee21a352fe906df376bc848518d5cb5eea4444f6b954dad5c898a66633bd060"}
Jul 13 15:53:05.308706 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:05.308313    2556 scope.go:117] "RemoveContainer" containerID="515ff800c12c7ca74bd4f97f8f6111fa8fda2fc8e9f9dbe0e19ad8e4ac8b063d"
Jul 13 15:53:06.341969 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:06.341934    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"]
Jul 13 15:53:06.450389 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:06.450365    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"
Jul 13 15:53:06.510572 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:06.510547    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baeefcf3-9043-41a8-ade0-9530b21acaff-maas-api-service-ca\") pod \"baeefcf3-9043-41a8-ade0-9530b21acaff\" (UID: \"baeefcf3-9043-41a8-ade0-9530b21acaff\") "
Jul 13 15:53:06.510872 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:06.510850    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baeefcf3-9043-41a8-ade0-9530b21acaff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "baeefcf3-9043-41a8-ade0-9530b21acaff" (UID: "baeefcf3-9043-41a8-ade0-9530b21acaff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:53:06.611750 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:06.611680    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/baeefcf3-9043-41a8-ade0-9530b21acaff-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:53:07.323941 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:07.323904    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k" event={"ID":"baeefcf3-9043-41a8-ade0-9530b21acaff","Type":"ContainerDied","Data":"f6d49c4b3ae52d7e3b70bf4c610eeddb3bdff45e356724dc52f603aa58655271"}
Jul 13 15:53:07.324099 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:07.323946    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"
Jul 13 15:53:07.324099 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:07.323951    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6d49c4b3ae52d7e3b70bf4c610eeddb3bdff45e356724dc52f603aa58655271"
Jul 13 15:53:07.350981 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:07.350906    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"]
Jul 13 15:53:07.356287 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:07.356246    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-l6h5k"]
Jul 13 15:53:09.079574 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:09.079544    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" path="/var/lib/kubelet/pods/baeefcf3-9043-41a8-ade0-9530b21acaff/volumes"
Jul 13 15:53:39.466251 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.466219    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"]
Jul 13 15:53:39.466722 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.466625    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:53:39.466722 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.466637    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:53:39.466722 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.466652    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:53:39.466722 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.466658    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:53:39.466848 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.466730    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:53:39.466848 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.466741    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:53:39.469365 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.469349    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"
Jul 13 15:53:39.471493 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.471466    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:53:39.471611 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.471502    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:53:39.476287 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.476250    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"]
Jul 13 15:53:39.509195 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.509163    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8747b23-260c-4061-b73c-dda8ad5c79da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d997b9d6-749q9\" (UID: \"d8747b23-260c-4061-b73c-dda8ad5c79da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"
Jul 13 15:53:39.610405 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.610376    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8747b23-260c-4061-b73c-dda8ad5c79da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d997b9d6-749q9\" (UID: \"d8747b23-260c-4061-b73c-dda8ad5c79da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"
Jul 13 15:53:39.610984 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.610965    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8747b23-260c-4061-b73c-dda8ad5c79da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d997b9d6-749q9\" (UID: \"d8747b23-260c-4061-b73c-dda8ad5c79da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"
Jul 13 15:53:39.781552 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.781482    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"
Jul 13 15:53:39.911280 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:39.911230    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"]
Jul 13 15:53:39.914893 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:53:39.914863    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8747b23_260c_4061_b73c_dda8ad5c79da.slice/crio-1e676385d54d0bf01ce4572798d67c7647275241aed1713d3204324bcaabff2d WatchSource:0}: Error finding container 1e676385d54d0bf01ce4572798d67c7647275241aed1713d3204324bcaabff2d: Status 404 returned error can't find the container with id 1e676385d54d0bf01ce4572798d67c7647275241aed1713d3204324bcaabff2d
Jul 13 15:53:40.498493 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:40.498463    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9" event={"ID":"d8747b23-260c-4061-b73c-dda8ad5c79da","Type":"ContainerStarted","Data":"084ebc2b4701ccef97cbf6baf981a0c26082dd8efe983fdc57bde71471c8f581"}
Jul 13 15:53:40.498785 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:40.498519    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9" event={"ID":"d8747b23-260c-4061-b73c-dda8ad5c79da","Type":"ContainerStarted","Data":"1e676385d54d0bf01ce4572798d67c7647275241aed1713d3204324bcaabff2d"}
Jul 13 15:53:41.504213 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:41.504180    2556 generic.go:356] "Generic (PLEG): container finished" podID="d8747b23-260c-4061-b73c-dda8ad5c79da" containerID="084ebc2b4701ccef97cbf6baf981a0c26082dd8efe983fdc57bde71471c8f581" exitCode=0
Jul 13 15:53:41.504605 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:41.504260    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9" event={"ID":"d8747b23-260c-4061-b73c-dda8ad5c79da","Type":"ContainerDied","Data":"084ebc2b4701ccef97cbf6baf981a0c26082dd8efe983fdc57bde71471c8f581"}
Jul 13 15:53:41.634690 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:41.634664    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"
Jul 13 15:53:41.729253 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:41.729211    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8747b23-260c-4061-b73c-dda8ad5c79da-maas-api-service-ca\") pod \"d8747b23-260c-4061-b73c-dda8ad5c79da\" (UID: \"d8747b23-260c-4061-b73c-dda8ad5c79da\") "
Jul 13 15:53:41.729615 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:41.729593    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8747b23-260c-4061-b73c-dda8ad5c79da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d8747b23-260c-4061-b73c-dda8ad5c79da" (UID: "d8747b23-260c-4061-b73c-dda8ad5c79da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:53:41.829974 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:41.829881    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8747b23-260c-4061-b73c-dda8ad5c79da-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:53:42.510610 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:42.510582    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9"
Jul 13 15:53:42.511024 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:42.510585    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d997b9d6-749q9" event={"ID":"d8747b23-260c-4061-b73c-dda8ad5c79da","Type":"ContainerDied","Data":"1e676385d54d0bf01ce4572798d67c7647275241aed1713d3204324bcaabff2d"}
Jul 13 15:53:42.511024 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:53:42.510713    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e676385d54d0bf01ce4572798d67c7647275241aed1713d3204324bcaabff2d"
Jul 13 15:54:07.026590 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:54:07.026563    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:54:07.027084 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:54:07.026571    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:55:56.357097 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.357059    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"]
Jul 13 15:55:56.357555 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.357436    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:55:56.357555 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.357448    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:55:56.357555 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.357462    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8747b23-260c-4061-b73c-dda8ad5c79da" containerName="revoke-keys"
Jul 13 15:55:56.357555 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.357467    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8747b23-260c-4061-b73c-dda8ad5c79da" containerName="revoke-keys"
Jul 13 15:55:56.357555 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.357535    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8747b23-260c-4061-b73c-dda8ad5c79da" containerName="revoke-keys"
Jul 13 15:55:56.357555 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.357547    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="baeefcf3-9043-41a8-ade0-9530b21acaff" containerName="revoke-keys"
Jul 13 15:55:56.360626 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.360609    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"
Jul 13 15:55:56.362909 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.362886    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:55:56.363028 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.362886    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:55:56.367394 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.367366    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"]
Jul 13 15:55:56.430506 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.430474    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7aac28-9cb3-4923-8fb0-1c2306b9e078-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6270d141-nrpt6\" (UID: \"1e7aac28-9cb3-4923-8fb0-1c2306b9e078\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"
Jul 13 15:55:56.531332 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.531302    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7aac28-9cb3-4923-8fb0-1c2306b9e078-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6270d141-nrpt6\" (UID: \"1e7aac28-9cb3-4923-8fb0-1c2306b9e078\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"
Jul 13 15:55:56.531920 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.531900    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7aac28-9cb3-4923-8fb0-1c2306b9e078-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6270d141-nrpt6\" (UID: \"1e7aac28-9cb3-4923-8fb0-1c2306b9e078\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"
Jul 13 15:55:56.672723 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.672688    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"
Jul 13 15:55:56.808986 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:56.808960    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"]
Jul 13 15:55:56.811234 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:55:56.811207    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7aac28_9cb3_4923_8fb0_1c2306b9e078.slice/crio-5ca94dfd42bd79d355f764bfc56822391fce71bccdc69cd87838a1f77cfc7b1f WatchSource:0}: Error finding container 5ca94dfd42bd79d355f764bfc56822391fce71bccdc69cd87838a1f77cfc7b1f: Status 404 returned error can't find the container with id 5ca94dfd42bd79d355f764bfc56822391fce71bccdc69cd87838a1f77cfc7b1f
Jul 13 15:55:57.200228 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:57.200195    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6" event={"ID":"1e7aac28-9cb3-4923-8fb0-1c2306b9e078","Type":"ContainerStarted","Data":"ceadc34ce8cf7dc03c30c0bd5992e7d80921231bd5d6db372179b32914a2e259"}
Jul 13 15:55:57.200438 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:57.200248    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6" event={"ID":"1e7aac28-9cb3-4923-8fb0-1c2306b9e078","Type":"ContainerStarted","Data":"5ca94dfd42bd79d355f764bfc56822391fce71bccdc69cd87838a1f77cfc7b1f"}
Jul 13 15:55:57.217663 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:57.217616    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6" podStartSLOduration=1.217601907 podStartE2EDuration="1.217601907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:55:57.215365592 +0000 UTC m=+1910.776056080" watchObservedRunningTime="2026-07-13 15:55:57.217601907 +0000 UTC m=+1910.778292440"
Jul 13 15:55:58.206650 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:58.206618    2556 generic.go:356] "Generic (PLEG): container finished" podID="1e7aac28-9cb3-4923-8fb0-1c2306b9e078" containerID="ceadc34ce8cf7dc03c30c0bd5992e7d80921231bd5d6db372179b32914a2e259" exitCode=0
Jul 13 15:55:58.207089 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:58.206676    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6" event={"ID":"1e7aac28-9cb3-4923-8fb0-1c2306b9e078","Type":"ContainerDied","Data":"ceadc34ce8cf7dc03c30c0bd5992e7d80921231bd5d6db372179b32914a2e259"}
Jul 13 15:55:59.345997 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:59.345972    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"
Jul 13 15:55:59.460104 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:59.460073    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7aac28-9cb3-4923-8fb0-1c2306b9e078-maas-api-service-ca\") pod \"1e7aac28-9cb3-4923-8fb0-1c2306b9e078\" (UID: \"1e7aac28-9cb3-4923-8fb0-1c2306b9e078\") "
Jul 13 15:55:59.460453 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:59.460429    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e7aac28-9cb3-4923-8fb0-1c2306b9e078-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e7aac28-9cb3-4923-8fb0-1c2306b9e078" (UID: "1e7aac28-9cb3-4923-8fb0-1c2306b9e078"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:55:59.560890 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:55:59.560814    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e7aac28-9cb3-4923-8fb0-1c2306b9e078-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:56:00.217806 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:56:00.217769    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6"
Jul 13 15:56:00.217984 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:56:00.217803    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6270d141-nrpt6" event={"ID":"1e7aac28-9cb3-4923-8fb0-1c2306b9e078","Type":"ContainerDied","Data":"5ca94dfd42bd79d355f764bfc56822391fce71bccdc69cd87838a1f77cfc7b1f"}
Jul 13 15:56:00.217984 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:56:00.217861    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ca94dfd42bd79d355f764bfc56822391fce71bccdc69cd87838a1f77cfc7b1f"
Jul 13 15:57:22.401328 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.401294    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"]
Jul 13 15:57:22.401862 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.401660    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7aac28-9cb3-4923-8fb0-1c2306b9e078" containerName="revoke-keys"
Jul 13 15:57:22.401862 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.401671    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7aac28-9cb3-4923-8fb0-1c2306b9e078" containerName="revoke-keys"
Jul 13 15:57:22.401862 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.401742    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7aac28-9cb3-4923-8fb0-1c2306b9e078" containerName="revoke-keys"
Jul 13 15:57:22.404884 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.404854    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"
Jul 13 15:57:22.406968 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.406948    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:57:22.407083 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.407029    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:57:22.411994 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.411969    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"]
Jul 13 15:57:22.507980 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.507945    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3dcc88-bf47-428b-a2a8-7aa8900596ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt\" (UID: \"0b3dcc88-bf47-428b-a2a8-7aa8900596ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"
Jul 13 15:57:22.608945 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.608914    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3dcc88-bf47-428b-a2a8-7aa8900596ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt\" (UID: \"0b3dcc88-bf47-428b-a2a8-7aa8900596ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"
Jul 13 15:57:22.609589 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.609569    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3dcc88-bf47-428b-a2a8-7aa8900596ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt\" (UID: \"0b3dcc88-bf47-428b-a2a8-7aa8900596ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"
Jul 13 15:57:22.717642 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.717562    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"
Jul 13 15:57:22.872459 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:22.870245    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"]
Jul 13 15:57:22.873454 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:57:22.873422    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3dcc88_bf47_428b_a2a8_7aa8900596ba.slice/crio-0dbdf601ee4966e578eff4f57f7ac5f008ef13de5f12d4b10e6e2bfcd5647082 WatchSource:0}: Error finding container 0dbdf601ee4966e578eff4f57f7ac5f008ef13de5f12d4b10e6e2bfcd5647082: Status 404 returned error can't find the container with id 0dbdf601ee4966e578eff4f57f7ac5f008ef13de5f12d4b10e6e2bfcd5647082
Jul 13 15:57:23.653425 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:23.653385    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt" event={"ID":"0b3dcc88-bf47-428b-a2a8-7aa8900596ba","Type":"ContainerStarted","Data":"e0431e5033ae8d7bafccd8f2385a0e0b75d4acc96e26e8b1758f2e895a4b0efa"}
Jul 13 15:57:23.653818 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:23.653449    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt" event={"ID":"0b3dcc88-bf47-428b-a2a8-7aa8900596ba","Type":"ContainerStarted","Data":"0dbdf601ee4966e578eff4f57f7ac5f008ef13de5f12d4b10e6e2bfcd5647082"}
Jul 13 15:57:23.671451 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:23.671402    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt" podStartSLOduration=1.671386984 podStartE2EDuration="1.671386984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:57:23.669333984 +0000 UTC m=+1997.230024473" watchObservedRunningTime="2026-07-13 15:57:23.671386984 +0000 UTC m=+1997.232077471"
Jul 13 15:57:24.660420 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:24.660383    2556 generic.go:356] "Generic (PLEG): container finished" podID="0b3dcc88-bf47-428b-a2a8-7aa8900596ba" containerID="e0431e5033ae8d7bafccd8f2385a0e0b75d4acc96e26e8b1758f2e895a4b0efa" exitCode=0
Jul 13 15:57:24.660793 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:24.660475    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt" event={"ID":"0b3dcc88-bf47-428b-a2a8-7aa8900596ba","Type":"ContainerDied","Data":"e0431e5033ae8d7bafccd8f2385a0e0b75d4acc96e26e8b1758f2e895a4b0efa"}
Jul 13 15:57:25.798377 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:25.798352    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"
Jul 13 15:57:25.946809 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:25.946726    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3dcc88-bf47-428b-a2a8-7aa8900596ba-maas-api-service-ca\") pod \"0b3dcc88-bf47-428b-a2a8-7aa8900596ba\" (UID: \"0b3dcc88-bf47-428b-a2a8-7aa8900596ba\") "
Jul 13 15:57:25.947060 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:25.947036    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b3dcc88-bf47-428b-a2a8-7aa8900596ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0b3dcc88-bf47-428b-a2a8-7aa8900596ba" (UID: "0b3dcc88-bf47-428b-a2a8-7aa8900596ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:57:26.047711 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:26.047682    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b3dcc88-bf47-428b-a2a8-7aa8900596ba-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 15:57:26.671042 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:26.671005    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt" event={"ID":"0b3dcc88-bf47-428b-a2a8-7aa8900596ba","Type":"ContainerDied","Data":"0dbdf601ee4966e578eff4f57f7ac5f008ef13de5f12d4b10e6e2bfcd5647082"}
Jul 13 15:57:26.671042 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:26.671039    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt"
Jul 13 15:57:26.671236 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:57:26.671055    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dbdf601ee4966e578eff4f57f7ac5f008ef13de5f12d4b10e6e2bfcd5647082"
Jul 13 15:58:07.090089 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:58:07.090055    2556 scope.go:117] "RemoveContainer" containerID="f5b91b8076e8c4ba7df0d7862caa4fefd0c2b8baba3efd03e980e04573f74496"
Jul 13 15:59:07.057922 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:07.057892    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:59:07.060006 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:07.059981    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 15:59:07.109490 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:07.109463    2556 scope.go:117] "RemoveContainer" containerID="9ee21a352fe906df376bc848518d5cb5eea4444f6b954dad5c898a66633bd060"
Jul 13 15:59:42.830507 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.830475    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"]
Jul 13 15:59:42.831023 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.830885    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3dcc88-bf47-428b-a2a8-7aa8900596ba" containerName="revoke-keys"
Jul 13 15:59:42.831023 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.830900    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3dcc88-bf47-428b-a2a8-7aa8900596ba" containerName="revoke-keys"
Jul 13 15:59:42.831023 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.830999    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b3dcc88-bf47-428b-a2a8-7aa8900596ba" containerName="revoke-keys"
Jul 13 15:59:42.834382 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.834363    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.836766 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.836747    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ef5b3f-openshift-default-dockercfg-4gnfk\""
Jul 13 15:59:42.845839 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.845790    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"]
Jul 13 15:59:42.971721 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-podinfo\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.971896 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971732    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-socket\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.971896 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-credential-socket\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.971896 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-envoy\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.971896 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971875    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-certs\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.971896 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b885fa-328b-47ee-8233-7c52a8dfd302-istiod-ca-cert\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.972403 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971935    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k79mz\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-kube-api-access-k79mz\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.972403 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-token\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:42.972403 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:42.971983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-data\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072616 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072586    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-token\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072616 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072619    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-data\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072868 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072678    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-podinfo\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072868 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072703    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-socket\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072868 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072737    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-credential-socket\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072868 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-envoy\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072868 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072774    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-certs\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.072868 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.072796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b885fa-328b-47ee-8233-7c52a8dfd302-istiod-ca-cert\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.073196 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.073082    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-data\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.073196 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.073135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k79mz\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-kube-api-access-k79mz\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.073329 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.073223    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-credential-socket\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.073391 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.073360    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-certs\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.073559 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.073536    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b885fa-328b-47ee-8233-7c52a8dfd302-istiod-ca-cert\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.073729 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.073556    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-socket\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.075192 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.075165    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-envoy\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.075787 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.075762    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-podinfo\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.080488 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.080459    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-token\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.081009 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.080955    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k79mz\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-kube-api-access-k79mz\") pod \"e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") " pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.145287 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.145239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:43.285293 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.285248    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"]
Jul 13 15:59:43.287356 ip-10-0-139-109 kubenswrapper[2556]: W0713 15:59:43.287329    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b885fa_328b_47ee_8233_7c52a8dfd302.slice/crio-3e29ab26ddea5ed89fd6fe0284ffe9c2b1536177b05ba8881cb76f4b9522b68a WatchSource:0}: Error finding container 3e29ab26ddea5ed89fd6fe0284ffe9c2b1536177b05ba8881cb76f4b9522b68a: Status 404 returned error can't find the container with id 3e29ab26ddea5ed89fd6fe0284ffe9c2b1536177b05ba8881cb76f4b9522b68a
Jul 13 15:59:43.290376 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.290345    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:59:43.290487 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.290415    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:59:43.290487 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.290445    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:59:43.360088 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.360058    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" event={"ID":"a7b885fa-328b-47ee-8233-7c52a8dfd302","Type":"ContainerStarted","Data":"c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e"}
Jul 13 15:59:43.360184 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:43.360131    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" event={"ID":"a7b885fa-328b-47ee-8233-7c52a8dfd302","Type":"ContainerStarted","Data":"3e29ab26ddea5ed89fd6fe0284ffe9c2b1536177b05ba8881cb76f4b9522b68a"}
Jul 13 15:59:44.145812 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:44.145775    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:44.150684 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:44.150657    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:44.171857 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:44.171804    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" podStartSLOduration=2.171790214 podStartE2EDuration="2.171790214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:59:43.38370565 +0000 UTC m=+2136.944396137" watchObservedRunningTime="2026-07-13 15:59:44.171790214 +0000 UTC m=+2137.732480701"
Jul 13 15:59:44.365165 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:44.365134    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:44.365968 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:44.365944    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 15:59:59.366672 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.366644    2556 patch_prober.go:28] interesting pod/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 13 15:59:59.367013 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.366711    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 13 15:59:59.446671 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.446633    2556 generic.go:356] "Generic (PLEG): container finished" podID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerID="c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e" exitCode=0
Jul 13 15:59:59.446822 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.446708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" event={"ID":"a7b885fa-328b-47ee-8233-7c52a8dfd302","Type":"ContainerDied","Data":"c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e"}
Jul 13 15:59:59.447099 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.447085    2556 scope.go:117] "RemoveContainer" containerID="c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e"
Jul 13 15:59:59.448154 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.448129    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:59:59.448275 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.448250    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:59:59.448317 ip-10-0-139-109 kubenswrapper[2556]: I0713 15:59:59.448302    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:00:00.132027 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.131995    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg"]
Jul 13 16:00:00.135055 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.135025    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg"
Jul 13 16:00:00.135792 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.135773    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"]
Jul 13 16:00:00.137351 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.137331    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 16:00:00.138200 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.138185    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"]
Jul 13 16:00:00.138320 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.138303    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"
Jul 13 16:00:00.141491 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.141402    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"
Jul 13 16:00:00.142541 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.142519    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg"]
Jul 13 16:00:00.146446 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.146427    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"]
Jul 13 16:00:00.149106 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.149082    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"]
Jul 13 16:00:00.149437 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.149419    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg"
Jul 13 16:00:00.160164 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.160141    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"
Jul 13 16:00:00.217372 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.217255    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"
Jul 13 16:00:00.399392 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.393432    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"]
Jul 13 16:00:00.403078 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:00:00.402909    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381346ae_1b2a_4552_a5d8_e63bc2da1ca8.slice/crio-bdac7e7f7110ae33709ff02a585d2e952645b0df1ea8233723bbcfd449387c4a WatchSource:0}: Error finding container bdac7e7f7110ae33709ff02a585d2e952645b0df1ea8233723bbcfd449387c4a: Status 404 returned error can't find the container with id bdac7e7f7110ae33709ff02a585d2e952645b0df1ea8233723bbcfd449387c4a
Jul 13 16:00:00.451218 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.451196    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"]
Jul 13 16:00:00.454562 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:00:00.454532    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3aee8e_92ce_4473_8373_dac364bfb3e0.slice/crio-cbfeb9966983c9bf499212724f17feb9e38732148da5fa183410abd0b041f402 WatchSource:0}: Error finding container cbfeb9966983c9bf499212724f17feb9e38732148da5fa183410abd0b041f402: Status 404 returned error can't find the container with id cbfeb9966983c9bf499212724f17feb9e38732148da5fa183410abd0b041f402
Jul 13 16:00:00.461748 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.461704    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8" event={"ID":"381346ae-1b2a-4552-a5d8-e63bc2da1ca8","Type":"ContainerStarted","Data":"bdac7e7f7110ae33709ff02a585d2e952645b0df1ea8233723bbcfd449387c4a"}
Jul 13 16:00:00.463860 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.463829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" event={"ID":"a7b885fa-328b-47ee-8233-7c52a8dfd302","Type":"ContainerStarted","Data":"c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0"}
Jul 13 16:00:00.607720 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:00.607039    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg"]
Jul 13 16:00:00.611948 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:00:00.611913    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450ff591_38df_438b_92c4_71d16a9204a2.slice/crio-effa3545cac0c3d677888da538149d5fe35752417857160a6e538993d913cc72 WatchSource:0}: Error finding container effa3545cac0c3d677888da538149d5fe35752417857160a6e538993d913cc72: Status 404 returned error can't find the container with id effa3545cac0c3d677888da538149d5fe35752417857160a6e538993d913cc72
Jul 13 16:00:01.145712 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.145678    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 16:00:01.146289 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.146249    2556 patch_prober.go:28] interesting pod/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 13 16:00:01.146344 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.146317    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 13 16:00:01.471425 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.471390    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg" event={"ID":"450ff591-38df-438b-92c4-71d16a9204a2","Type":"ContainerStarted","Data":"b8217d846ba6cc7d9010b068cfe6aea8d92f491f97c67b26042a5bbdc21ea9e1"}
Jul 13 16:00:01.471918 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.471465    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg" event={"ID":"450ff591-38df-438b-92c4-71d16a9204a2","Type":"ContainerStarted","Data":"effa3545cac0c3d677888da538149d5fe35752417857160a6e538993d913cc72"}
Jul 13 16:00:01.472897 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.472875    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8" event={"ID":"381346ae-1b2a-4552-a5d8-e63bc2da1ca8","Type":"ContainerStarted","Data":"1b3a0689e6b2d2d5f77b44ea0c1e3ed30a4f5fc5849862d82f8ef439b1ff1eca"}
Jul 13 16:00:01.476322 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.476294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7" event={"ID":"7b3aee8e-92ce-4473-8373-dac364bfb3e0","Type":"ContainerStarted","Data":"37cb75c7bd2924f28840934e899965344488a882297c063912096bfdc033b734"}
Jul 13 16:00:01.476460 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.476341    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7" event={"ID":"7b3aee8e-92ce-4473-8373-dac364bfb3e0","Type":"ContainerStarted","Data":"cbfeb9966983c9bf499212724f17feb9e38732148da5fa183410abd0b041f402"}
Jul 13 16:00:01.489319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.489234    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg" podStartSLOduration=1.489213358 podStartE2EDuration="1.489213358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:00:01.485759345 +0000 UTC m=+2155.046449832" watchObservedRunningTime="2026-07-13 16:00:01.489213358 +0000 UTC m=+2155.049903846"
Jul 13 16:00:01.521803 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.521746    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8" podStartSLOduration=1.5217299149999999 podStartE2EDuration="1.521729915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:00:01.520165144 +0000 UTC m=+2155.080855627" watchObservedRunningTime="2026-07-13 16:00:01.521729915 +0000 UTC m=+2155.082420392"
Jul 13 16:00:01.522588 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:01.522548    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7" podStartSLOduration=1.522536853 podStartE2EDuration="1.522536853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:00:01.506478924 +0000 UTC m=+2155.067169412" watchObservedRunningTime="2026-07-13 16:00:01.522536853 +0000 UTC m=+2155.083227342"
Jul 13 16:00:02.146612 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.146574    2556 patch_prober.go:28] interesting pod/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 13 16:00:02.146786 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.146641    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 13 16:00:02.486941 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.486900    2556 generic.go:356] "Generic (PLEG): container finished" podID="450ff591-38df-438b-92c4-71d16a9204a2" containerID="b8217d846ba6cc7d9010b068cfe6aea8d92f491f97c67b26042a5bbdc21ea9e1" exitCode=0
Jul 13 16:00:02.487450 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.487028    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg" event={"ID":"450ff591-38df-438b-92c4-71d16a9204a2","Type":"ContainerDied","Data":"b8217d846ba6cc7d9010b068cfe6aea8d92f491f97c67b26042a5bbdc21ea9e1"}
Jul 13 16:00:02.489442 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.489410    2556 generic.go:356] "Generic (PLEG): container finished" podID="381346ae-1b2a-4552-a5d8-e63bc2da1ca8" containerID="1b3a0689e6b2d2d5f77b44ea0c1e3ed30a4f5fc5849862d82f8ef439b1ff1eca" exitCode=0
Jul 13 16:00:02.489559 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.489515    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8" event={"ID":"381346ae-1b2a-4552-a5d8-e63bc2da1ca8","Type":"ContainerDied","Data":"1b3a0689e6b2d2d5f77b44ea0c1e3ed30a4f5fc5849862d82f8ef439b1ff1eca"}
Jul 13 16:00:02.492457 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.492432    2556 generic.go:356] "Generic (PLEG): container finished" podID="7b3aee8e-92ce-4473-8373-dac364bfb3e0" containerID="37cb75c7bd2924f28840934e899965344488a882297c063912096bfdc033b734" exitCode=0
Jul 13 16:00:02.492790 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:02.492691    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7" event={"ID":"7b3aee8e-92ce-4473-8373-dac364bfb3e0","Type":"ContainerDied","Data":"37cb75c7bd2924f28840934e899965344488a882297c063912096bfdc033b734"}
Jul 13 16:00:03.145991 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:03.145954    2556 patch_prober.go:28] interesting pod/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 13 16:00:03.146173 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:03.146009    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 13 16:00:03.670974 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:03.670929    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg"
Jul 13 16:00:03.742255 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:03.742230    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"
Jul 13 16:00:03.745049 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:03.745021    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"
Jul 13 16:00:04.145966 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.145926    2556 patch_prober.go:28] interesting pod/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 13 16:00:04.146138 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.145988    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 13 16:00:04.511979 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.511948    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"
Jul 13 16:00:04.511979 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.511960    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8" event={"ID":"381346ae-1b2a-4552-a5d8-e63bc2da1ca8","Type":"ContainerDied","Data":"bdac7e7f7110ae33709ff02a585d2e952645b0df1ea8233723bbcfd449387c4a"}
Jul 13 16:00:04.512213 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.512009    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdac7e7f7110ae33709ff02a585d2e952645b0df1ea8233723bbcfd449387c4a"
Jul 13 16:00:04.513214 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.513192    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"
Jul 13 16:00:04.513356 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.513226    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7" event={"ID":"7b3aee8e-92ce-4473-8373-dac364bfb3e0","Type":"ContainerDied","Data":"cbfeb9966983c9bf499212724f17feb9e38732148da5fa183410abd0b041f402"}
Jul 13 16:00:04.513356 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.513294    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbfeb9966983c9bf499212724f17feb9e38732148da5fa183410abd0b041f402"
Jul 13 16:00:04.514565 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.514541    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg" event={"ID":"450ff591-38df-438b-92c4-71d16a9204a2","Type":"ContainerDied","Data":"effa3545cac0c3d677888da538149d5fe35752417857160a6e538993d913cc72"}
Jul 13 16:00:04.514652 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.514585    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="effa3545cac0c3d677888da538149d5fe35752417857160a6e538993d913cc72"
Jul 13 16:00:04.514652 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:04.514591    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732640-wtxpg"
Jul 13 16:00:05.150691 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:05.150666    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 16:00:05.151061 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:05.151009    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 16:00:05.151914 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:05.151896    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 16:00:44.476425 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476388    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"]
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476809    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450ff591-38df-438b-92c4-71d16a9204a2" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476822    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="450ff591-38df-438b-92c4-71d16a9204a2" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476834    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b3aee8e-92ce-4473-8373-dac364bfb3e0" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476843    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b3aee8e-92ce-4473-8373-dac364bfb3e0" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476867    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381346ae-1b2a-4552-a5d8-e63bc2da1ca8" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476874    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="381346ae-1b2a-4552-a5d8-e63bc2da1ca8" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476930    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="450ff591-38df-438b-92c4-71d16a9204a2" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476941    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="381346ae-1b2a-4552-a5d8-e63bc2da1ca8" containerName="cleanup"
Jul 13 16:00:44.477013 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.476948    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b3aee8e-92ce-4473-8373-dac364bfb3e0" containerName="cleanup"
Jul 13 16:00:44.479840 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.479816    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"
Jul 13 16:00:44.485484 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.485452    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 16:00:44.485651 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.485520    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 16:00:44.497340 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.497314    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"]
Jul 13 16:00:44.575388 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.575353    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565324d2-c87a-49c4-b6ff-5146b9ee8cb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w\" (UID: \"565324d2-c87a-49c4-b6ff-5146b9ee8cb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"
Jul 13 16:00:44.676235 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.676198    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565324d2-c87a-49c4-b6ff-5146b9ee8cb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w\" (UID: \"565324d2-c87a-49c4-b6ff-5146b9ee8cb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"
Jul 13 16:00:44.677026 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.677000    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565324d2-c87a-49c4-b6ff-5146b9ee8cb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w\" (UID: \"565324d2-c87a-49c4-b6ff-5146b9ee8cb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"
Jul 13 16:00:44.789984 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.789904    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"
Jul 13 16:00:44.935563 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:44.935537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"]
Jul 13 16:00:44.938196 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:00:44.938169    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565324d2_c87a_49c4_b6ff_5146b9ee8cb6.slice/crio-67b5393c82378678de1ba75344017a1b4b45365bab1893ae3189d120a75d8f36 WatchSource:0}: Error finding container 67b5393c82378678de1ba75344017a1b4b45365bab1893ae3189d120a75d8f36: Status 404 returned error can't find the container with id 67b5393c82378678de1ba75344017a1b4b45365bab1893ae3189d120a75d8f36
Jul 13 16:00:45.736620 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:45.736583    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w" event={"ID":"565324d2-c87a-49c4-b6ff-5146b9ee8cb6","Type":"ContainerStarted","Data":"8773ae0d3ac7b025f566d34d60c9e80a00e06f98ebdec7d38a5664ac4298f5bf"}
Jul 13 16:00:45.737090 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:45.736636    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w" event={"ID":"565324d2-c87a-49c4-b6ff-5146b9ee8cb6","Type":"ContainerStarted","Data":"67b5393c82378678de1ba75344017a1b4b45365bab1893ae3189d120a75d8f36"}
Jul 13 16:00:45.756010 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:45.755963    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w" podStartSLOduration=1.755948718 podStartE2EDuration="1.755948718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:00:45.753484332 +0000 UTC m=+2199.314174819" watchObservedRunningTime="2026-07-13 16:00:45.755948718 +0000 UTC m=+2199.316639228"
Jul 13 16:00:46.742882 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:46.742850    2556 generic.go:356] "Generic (PLEG): container finished" podID="565324d2-c87a-49c4-b6ff-5146b9ee8cb6" containerID="8773ae0d3ac7b025f566d34d60c9e80a00e06f98ebdec7d38a5664ac4298f5bf" exitCode=0
Jul 13 16:00:46.743287 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:46.742942    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w" event={"ID":"565324d2-c87a-49c4-b6ff-5146b9ee8cb6","Type":"ContainerDied","Data":"8773ae0d3ac7b025f566d34d60c9e80a00e06f98ebdec7d38a5664ac4298f5bf"}
Jul 13 16:00:47.887158 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:47.887132    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"
Jul 13 16:00:48.006540 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:48.006448    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565324d2-c87a-49c4-b6ff-5146b9ee8cb6-maas-api-service-ca\") pod \"565324d2-c87a-49c4-b6ff-5146b9ee8cb6\" (UID: \"565324d2-c87a-49c4-b6ff-5146b9ee8cb6\") "
Jul 13 16:00:48.006798 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:48.006779    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/565324d2-c87a-49c4-b6ff-5146b9ee8cb6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "565324d2-c87a-49c4-b6ff-5146b9ee8cb6" (UID: "565324d2-c87a-49c4-b6ff-5146b9ee8cb6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:00:48.107862 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:48.107833    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565324d2-c87a-49c4-b6ff-5146b9ee8cb6-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:00:48.753987 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:48.753963    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w"
Jul 13 16:00:48.754149 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:48.753961    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w" event={"ID":"565324d2-c87a-49c4-b6ff-5146b9ee8cb6","Type":"ContainerDied","Data":"67b5393c82378678de1ba75344017a1b4b45365bab1893ae3189d120a75d8f36"}
Jul 13 16:00:48.754149 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:48.754103    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67b5393c82378678de1ba75344017a1b4b45365bab1893ae3189d120a75d8f36"
Jul 13 16:00:55.034557 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:55.034523    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"]
Jul 13 16:00:55.036445 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:55.036423    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-47280f-29732640-2twr8"]
Jul 13 16:00:55.078980 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:00:55.078953    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381346ae-1b2a-4552-a5d8-e63bc2da1ca8" path="/var/lib/kubelet/pods/381346ae-1b2a-4552-a5d8-e63bc2da1ca8/volumes"
Jul 13 16:01:10.630601 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.630565    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"]
Jul 13 16:01:10.631117 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.631096    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="565324d2-c87a-49c4-b6ff-5146b9ee8cb6" containerName="revoke-keys"
Jul 13 16:01:10.631208 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.631120    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="565324d2-c87a-49c4-b6ff-5146b9ee8cb6" containerName="revoke-keys"
Jul 13 16:01:10.631318 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.631282    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="565324d2-c87a-49c4-b6ff-5146b9ee8cb6" containerName="revoke-keys"
Jul 13 16:01:10.634494 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.634474    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"
Jul 13 16:01:10.636870 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.636845    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 16:01:10.636964 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.636903    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 16:01:10.651563 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.651537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"]
Jul 13 16:01:10.820106 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.820068    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/011b0668-8308-4391-917b-8764fb2bf681-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97\" (UID: \"011b0668-8308-4391-917b-8764fb2bf681\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"
Jul 13 16:01:10.921586 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.921552    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/011b0668-8308-4391-917b-8764fb2bf681-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97\" (UID: \"011b0668-8308-4391-917b-8764fb2bf681\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"
Jul 13 16:01:10.922148 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.922129    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/011b0668-8308-4391-917b-8764fb2bf681-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97\" (UID: \"011b0668-8308-4391-917b-8764fb2bf681\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"
Jul 13 16:01:10.944467 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:10.944447    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"
Jul 13 16:01:11.096875 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:11.096850    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"]
Jul 13 16:01:11.872757 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:11.872723    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97" event={"ID":"011b0668-8308-4391-917b-8764fb2bf681","Type":"ContainerStarted","Data":"9de57ce4d56c02e1293660fc7a1cd426f1e54330d161949d41e1a04c1207ea74"}
Jul 13 16:01:11.873119 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:11.872778    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97" event={"ID":"011b0668-8308-4391-917b-8764fb2bf681","Type":"ContainerStarted","Data":"12a78de6768a09bf8bf7be9e8c15eae709c350ef3fe7e301e3ccc603de8008e3"}
Jul 13 16:01:11.893638 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:11.893594    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97" podStartSLOduration=1.893576656 podStartE2EDuration="1.893576656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:01:11.891527096 +0000 UTC m=+2225.452217583" watchObservedRunningTime="2026-07-13 16:01:11.893576656 +0000 UTC m=+2225.454267143"
Jul 13 16:01:12.880554 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:12.880512    2556 generic.go:356] "Generic (PLEG): container finished" podID="011b0668-8308-4391-917b-8764fb2bf681" containerID="9de57ce4d56c02e1293660fc7a1cd426f1e54330d161949d41e1a04c1207ea74" exitCode=0
Jul 13 16:01:12.881073 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:12.880590    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97" event={"ID":"011b0668-8308-4391-917b-8764fb2bf681","Type":"ContainerDied","Data":"9de57ce4d56c02e1293660fc7a1cd426f1e54330d161949d41e1a04c1207ea74"}
Jul 13 16:01:14.023529 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:14.023499    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"
Jul 13 16:01:14.047583 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:14.047558    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/011b0668-8308-4391-917b-8764fb2bf681-maas-api-service-ca\") pod \"011b0668-8308-4391-917b-8764fb2bf681\" (UID: \"011b0668-8308-4391-917b-8764fb2bf681\") "
Jul 13 16:01:14.047901 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:14.047877    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011b0668-8308-4391-917b-8764fb2bf681-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "011b0668-8308-4391-917b-8764fb2bf681" (UID: "011b0668-8308-4391-917b-8764fb2bf681"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:01:14.148939 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:14.148908    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/011b0668-8308-4391-917b-8764fb2bf681-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:14.892564 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:14.892530    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97"
Jul 13 16:01:14.892792 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:14.892578    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97" event={"ID":"011b0668-8308-4391-917b-8764fb2bf681","Type":"ContainerDied","Data":"12a78de6768a09bf8bf7be9e8c15eae709c350ef3fe7e301e3ccc603de8008e3"}
Jul 13 16:01:14.892792 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:14.892623    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12a78de6768a09bf8bf7be9e8c15eae709c350ef3fe7e301e3ccc603de8008e3"
Jul 13 16:01:21.353999 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:21.353961    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"]
Jul 13 16:01:21.357093 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:21.357066    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-ef5b3f-29732640-xr9z7"]
Jul 13 16:01:23.079971 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:23.079936    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b3aee8e-92ce-4473-8373-dac364bfb3e0" path="/var/lib/kubelet/pods/7b3aee8e-92ce-4473-8373-dac364bfb3e0/volumes"
Jul 13 16:01:36.446651 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:36.446565    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"]
Jul 13 16:01:36.447117 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:36.446827    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy" containerID="cri-o://c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0" gracePeriod=30
Jul 13 16:01:41.697670 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.697646    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 16:01:41.801234 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801146    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-envoy\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801234 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801197    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-certs\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801234 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801228    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-token\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801533 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801281    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-data\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801533 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801323    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-socket\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801533 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801366    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-credential-socket\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801533 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801392    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k79mz\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-kube-api-access-k79mz\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801533 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801423    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b885fa-328b-47ee-8233-7c52a8dfd302-istiod-ca-cert\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801533 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801467    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-podinfo\") pod \"a7b885fa-328b-47ee-8233-7c52a8dfd302\" (UID: \"a7b885fa-328b-47ee-8233-7c52a8dfd302\") "
Jul 13 16:01:41.801858 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801576    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:41.801858 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801702    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:41.801858 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801844    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-certs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.802023 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801865    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-workload-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.802023 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.801905    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:41.802194 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.802174    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b885fa-328b-47ee-8233-7c52a8dfd302-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:01:41.802254 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.802231    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:41.803937 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.803907    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:41.804063 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.804024    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 16:01:41.804183 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.804161    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-kube-api-access-k79mz" (OuterVolumeSpecName: "kube-api-access-k79mz") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "kube-api-access-k79mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:01:41.804350 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.804328    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7b885fa-328b-47ee-8233-7c52a8dfd302" (UID: "a7b885fa-328b-47ee-8233-7c52a8dfd302"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:01:41.902736 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.902698    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-token\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.902736 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.902731    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-data\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.902736 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.902744    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-credential-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.902969 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.902757    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k79mz\" (UniqueName: \"kubernetes.io/projected/a7b885fa-328b-47ee-8233-7c52a8dfd302-kube-api-access-k79mz\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.902969 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.902770    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b885fa-328b-47ee-8233-7c52a8dfd302-istiod-ca-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.902969 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.902781    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-podinfo\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:41.902969 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:41.902791    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b885fa-328b-47ee-8233-7c52a8dfd302-istio-envoy\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:01:42.035437 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.035403    2556 generic.go:356] "Generic (PLEG): container finished" podID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerID="c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0" exitCode=0
Jul 13 16:01:42.035606 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.035486    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"
Jul 13 16:01:42.035606 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.035493    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" event={"ID":"a7b885fa-328b-47ee-8233-7c52a8dfd302","Type":"ContainerDied","Data":"c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0"}
Jul 13 16:01:42.035606 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.035575    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2" event={"ID":"a7b885fa-328b-47ee-8233-7c52a8dfd302","Type":"ContainerDied","Data":"3e29ab26ddea5ed89fd6fe0284ffe9c2b1536177b05ba8881cb76f4b9522b68a"}
Jul 13 16:01:42.035606 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.035596    2556 scope.go:117] "RemoveContainer" containerID="c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0"
Jul 13 16:01:42.044953 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.044934    2556 scope.go:117] "RemoveContainer" containerID="c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e"
Jul 13 16:01:42.053537 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.053521    2556 scope.go:117] "RemoveContainer" containerID="c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0"
Jul 13 16:01:42.053774 ip-10-0-139-109 kubenswrapper[2556]: E0713 16:01:42.053755    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0\": container with ID starting with c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0 not found: ID does not exist" containerID="c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0"
Jul 13 16:01:42.053849 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.053787    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0"} err="failed to get container status \"c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0\": rpc error: code = NotFound desc = could not find container \"c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0\": container with ID starting with c93c4ab015ecdf411136560a8e72a8a4f1f66cef36148c278fb41285270868a0 not found: ID does not exist"
Jul 13 16:01:42.053849 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.053810    2556 scope.go:117] "RemoveContainer" containerID="c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e"
Jul 13 16:01:42.054029 ip-10-0-139-109 kubenswrapper[2556]: E0713 16:01:42.054014    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e\": container with ID starting with c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e not found: ID does not exist" containerID="c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e"
Jul 13 16:01:42.054068 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.054035    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e"} err="failed to get container status \"c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e\": rpc error: code = NotFound desc = could not find container \"c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e\": container with ID starting with c7390f9f170fdf1a5f69f8737283aaa40b26c6a6dd14ac146c5ddd7925cfd61e not found: ID does not exist"
Jul 13 16:01:42.062429 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.062409    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"]
Jul 13 16:01:42.066699 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:42.066677    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ef5b3f-openshift-default-f89b988f-jf8r2"]
Jul 13 16:01:43.079153 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:43.079120    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" path="/var/lib/kubelet/pods/a7b885fa-328b-47ee-8233-7c52a8dfd302/volumes"
Jul 13 16:01:45.456858 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.456830    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"]
Jul 13 16:01:45.457250 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457200    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy"
Jul 13 16:01:45.457250 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457212    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy"
Jul 13 16:01:45.457250 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457229    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011b0668-8308-4391-917b-8764fb2bf681" containerName="revoke-keys"
Jul 13 16:01:45.457250 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457235    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="011b0668-8308-4391-917b-8764fb2bf681" containerName="revoke-keys"
Jul 13 16:01:45.457250 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457241    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy"
Jul 13 16:01:45.457250 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457247    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy"
Jul 13 16:01:45.457487 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457323    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy"
Jul 13 16:01:45.457487 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457331    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="011b0668-8308-4391-917b-8764fb2bf681" containerName="revoke-keys"
Jul 13 16:01:45.457487 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.457340    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b885fa-328b-47ee-8233-7c52a8dfd302" containerName="istio-proxy"
Jul 13 16:01:45.461730 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.461707    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.464203 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.464180    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-68976d-openshift-default-dockercfg-rk5v2\""
Jul 13 16:01:45.472585 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.472563    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"]
Jul 13 16:01:45.540135 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-credential-socket\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-socket\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540174    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-token\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540201    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-data\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-envoy\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540275    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8562n\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-kube-api-access-8562n\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-podinfo\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540521 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-certs\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.540521 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.540355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1c72b19-828b-4bd6-ba51-508f399b8707-istiod-ca-cert\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641198 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-certs\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641198 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641207    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1c72b19-828b-4bd6-ba51-508f399b8707-istiod-ca-cert\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641436 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641257    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-credential-socket\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641436 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-socket\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641436 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641350    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-token\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641436 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-data\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641436 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-envoy\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641436 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8562n\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-kube-api-access-8562n\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641749 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641462    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-podinfo\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641749 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641642    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-certs\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641749 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641711    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-credential-socket\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641896 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-socket\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641896 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-data\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.641982 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.641966    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1c72b19-828b-4bd6-ba51-508f399b8707-istiod-ca-cert\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.643618 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.643597    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-envoy\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.644100 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.644078    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-podinfo\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.649082 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.649061    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-token\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.649341 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.649324    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8562n\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-kube-api-access-8562n\") pod \"e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") " pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.772887 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.772804    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:45.915298 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.915256    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"]
Jul 13 16:01:45.917656 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:01:45.917625    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c72b19_828b_4bd6_ba51_508f399b8707.slice/crio-9d8a8e767348390c04509216fc30ddc690c6a5193dc26953aa96ac215dcfb736 WatchSource:0}: Error finding container 9d8a8e767348390c04509216fc30ddc690c6a5193dc26953aa96ac215dcfb736: Status 404 returned error can't find the container with id 9d8a8e767348390c04509216fc30ddc690c6a5193dc26953aa96ac215dcfb736
Jul 13 16:01:45.919865 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.919825    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:01:45.919949 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.919911    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:01:45.919987 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:45.919952    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:01:46.061631 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:46.061535    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" event={"ID":"f1c72b19-828b-4bd6-ba51-508f399b8707","Type":"ContainerStarted","Data":"093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145"}
Jul 13 16:01:46.061631 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:46.061585    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" event={"ID":"f1c72b19-828b-4bd6-ba51-508f399b8707","Type":"ContainerStarted","Data":"9d8a8e767348390c04509216fc30ddc690c6a5193dc26953aa96ac215dcfb736"}
Jul 13 16:01:46.087824 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:46.087756    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" podStartSLOduration=1.087735186 podStartE2EDuration="1.087735186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:01:46.084803796 +0000 UTC m=+2259.645494276" watchObservedRunningTime="2026-07-13 16:01:46.087735186 +0000 UTC m=+2259.648425674"
Jul 13 16:01:46.773663 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:46.773626    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:46.775246 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:46.775217    2556 patch_prober.go:28] interesting pod/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 13 16:01:46.775396 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:46.775294    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 13 16:01:47.777664 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:47.777633    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:48.078000 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:48.077911    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:01:48.079087 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:01:48.079063    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:02:00.143744 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.143705    2556 generic.go:356] "Generic (PLEG): container finished" podID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerID="093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145" exitCode=0
Jul 13 16:02:00.144256 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.143780    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" event={"ID":"f1c72b19-828b-4bd6-ba51-508f399b8707","Type":"ContainerDied","Data":"093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145"}
Jul 13 16:02:00.144256 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.144186    2556 scope.go:117] "RemoveContainer" containerID="093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145"
Jul 13 16:02:00.145221 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.145195    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:02:00.145312 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.145280    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:02:00.145356 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.145317    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:02:00.511203 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.511165    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"]
Jul 13 16:02:00.514399 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.514381    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"
Jul 13 16:02:00.516705 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.516679    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 16:02:00.516889 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.516870    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 16:02:00.520922 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.520895    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"]
Jul 13 16:02:00.579990 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.579952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6a7287-6de7-489c-9982-19e2a9da3289-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-714794-bxggz\" (UID: \"cc6a7287-6de7-489c-9982-19e2a9da3289\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"
Jul 13 16:02:00.681483 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.681442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6a7287-6de7-489c-9982-19e2a9da3289-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-714794-bxggz\" (UID: \"cc6a7287-6de7-489c-9982-19e2a9da3289\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"
Jul 13 16:02:00.682073 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.682051    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6a7287-6de7-489c-9982-19e2a9da3289-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-714794-bxggz\" (UID: \"cc6a7287-6de7-489c-9982-19e2a9da3289\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"
Jul 13 16:02:00.827395 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.827314    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"
Jul 13 16:02:00.997423 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:00.997397    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"]
Jul 13 16:02:00.999021 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:02:00.998994    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6a7287_6de7_489c_9982_19e2a9da3289.slice/crio-2720c88f1355701f04e843676972604a6514b135d5a374ae0d284437889da3d7 WatchSource:0}: Error finding container 2720c88f1355701f04e843676972604a6514b135d5a374ae0d284437889da3d7: Status 404 returned error can't find the container with id 2720c88f1355701f04e843676972604a6514b135d5a374ae0d284437889da3d7
Jul 13 16:02:01.155162 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:01.155133    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" event={"ID":"f1c72b19-828b-4bd6-ba51-508f399b8707","Type":"ContainerStarted","Data":"dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3"}
Jul 13 16:02:01.156369 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:01.156342    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz" event={"ID":"cc6a7287-6de7-489c-9982-19e2a9da3289","Type":"ContainerStarted","Data":"2720c88f1355701f04e843676972604a6514b135d5a374ae0d284437889da3d7"}
Jul 13 16:02:01.773841 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:01.773800    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:02:01.775163 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:01.775130    2556 patch_prober.go:28] interesting pod/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 13 16:02:01.775329 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:01.775195    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 13 16:02:02.164372 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:02.164334    2556 generic.go:356] "Generic (PLEG): container finished" podID="cc6a7287-6de7-489c-9982-19e2a9da3289" containerID="6f12db0888d0887ca83593be2a0a3e97c786eae5dc151c39d82ed422afb72c89" exitCode=0
Jul 13 16:02:02.164759 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:02.164420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz" event={"ID":"cc6a7287-6de7-489c-9982-19e2a9da3289","Type":"ContainerDied","Data":"6f12db0888d0887ca83593be2a0a3e97c786eae5dc151c39d82ed422afb72c89"}
Jul 13 16:02:02.773807 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:02.773760    2556 patch_prober.go:28] interesting pod/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 13 16:02:02.774028 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:02.773831    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 13 16:02:03.082380 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:03.082293    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:02:03.355826 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:03.355805    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"
Jul 13 16:02:03.410812 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:03.410711    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6a7287-6de7-489c-9982-19e2a9da3289-maas-api-service-ca\") pod \"cc6a7287-6de7-489c-9982-19e2a9da3289\" (UID: \"cc6a7287-6de7-489c-9982-19e2a9da3289\") "
Jul 13 16:02:03.411025 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:03.411000    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc6a7287-6de7-489c-9982-19e2a9da3289-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc6a7287-6de7-489c-9982-19e2a9da3289" (UID: "cc6a7287-6de7-489c-9982-19e2a9da3289"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:02:03.511962 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:03.511929    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6a7287-6de7-489c-9982-19e2a9da3289-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:03.774084 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:03.774037    2556 patch_prober.go:28] interesting pod/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 13 16:02:03.774315 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:03.774108    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 13 16:02:04.202289 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:04.200164    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz" event={"ID":"cc6a7287-6de7-489c-9982-19e2a9da3289","Type":"ContainerDied","Data":"2720c88f1355701f04e843676972604a6514b135d5a374ae0d284437889da3d7"}
Jul 13 16:02:04.202289 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:04.200336    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2720c88f1355701f04e843676972604a6514b135d5a374ae0d284437889da3d7"
Jul 13 16:02:04.202289 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:04.200397    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-714794-bxggz"
Jul 13 16:02:04.773815 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:04.773779    2556 patch_prober.go:28] interesting pod/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 13 16:02:04.774391 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:04.774356    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 13 16:02:05.778259 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:05.778228    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:02:05.779367 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:05.779342    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:02:26.633639 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.633605    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"]
Jul 13 16:02:26.634211 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.633997    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6a7287-6de7-489c-9982-19e2a9da3289" containerName="revoke-keys"
Jul 13 16:02:26.634211 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.634009    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6a7287-6de7-489c-9982-19e2a9da3289" containerName="revoke-keys"
Jul 13 16:02:26.634211 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.634085    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6a7287-6de7-489c-9982-19e2a9da3289" containerName="revoke-keys"
Jul 13 16:02:26.636334 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.636315    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"
Jul 13 16:02:26.638444 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.638414    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 16:02:26.638589 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.638527    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 16:02:26.644315 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.644293    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"]
Jul 13 16:02:26.726354 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.726317    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476809b-a5df-43f4-b23a-3c2919f4da2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-68976d-rbdrm\" (UID: \"a476809b-a5df-43f4-b23a-3c2919f4da2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"
Jul 13 16:02:26.827162 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.827128    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476809b-a5df-43f4-b23a-3c2919f4da2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-68976d-rbdrm\" (UID: \"a476809b-a5df-43f4-b23a-3c2919f4da2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"
Jul 13 16:02:26.827779 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.827760    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476809b-a5df-43f4-b23a-3c2919f4da2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-68976d-rbdrm\" (UID: \"a476809b-a5df-43f4-b23a-3c2919f4da2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"
Jul 13 16:02:26.947408 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:26.947377    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"
Jul 13 16:02:27.083782 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:27.083758    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"]
Jul 13 16:02:27.085914 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:02:27.085880    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda476809b_a5df_43f4_b23a_3c2919f4da2d.slice/crio-0191f1aa701515392bc7bb31190ecb6dbfc5317874b04c500a220ba7e516477a WatchSource:0}: Error finding container 0191f1aa701515392bc7bb31190ecb6dbfc5317874b04c500a220ba7e516477a: Status 404 returned error can't find the container with id 0191f1aa701515392bc7bb31190ecb6dbfc5317874b04c500a220ba7e516477a
Jul 13 16:02:27.322787 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:27.322756    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm" event={"ID":"a476809b-a5df-43f4-b23a-3c2919f4da2d","Type":"ContainerStarted","Data":"0191f1aa701515392bc7bb31190ecb6dbfc5317874b04c500a220ba7e516477a"}
Jul 13 16:02:28.329993 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:28.329953    2556 generic.go:356] "Generic (PLEG): container finished" podID="a476809b-a5df-43f4-b23a-3c2919f4da2d" containerID="5e326788802740ef8d187843c6b77c6fdb1c1bd56966ecaec97ac092ce49481f" exitCode=0
Jul 13 16:02:28.330363 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:28.330009    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm" event={"ID":"a476809b-a5df-43f4-b23a-3c2919f4da2d","Type":"ContainerDied","Data":"5e326788802740ef8d187843c6b77c6fdb1c1bd56966ecaec97ac092ce49481f"}
Jul 13 16:02:29.499351 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:29.499328    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"
Jul 13 16:02:29.655164 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:29.655139    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476809b-a5df-43f4-b23a-3c2919f4da2d-maas-api-service-ca\") pod \"a476809b-a5df-43f4-b23a-3c2919f4da2d\" (UID: \"a476809b-a5df-43f4-b23a-3c2919f4da2d\") "
Jul 13 16:02:29.655517 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:29.655494    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a476809b-a5df-43f4-b23a-3c2919f4da2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a476809b-a5df-43f4-b23a-3c2919f4da2d" (UID: "a476809b-a5df-43f4-b23a-3c2919f4da2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:02:29.756592 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:29.756561    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476809b-a5df-43f4-b23a-3c2919f4da2d-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:30.348029 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:30.347999    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm"
Jul 13 16:02:30.348029 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:30.348019    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-68976d-rbdrm" event={"ID":"a476809b-a5df-43f4-b23a-3c2919f4da2d","Type":"ContainerDied","Data":"0191f1aa701515392bc7bb31190ecb6dbfc5317874b04c500a220ba7e516477a"}
Jul 13 16:02:30.348234 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:30.348083    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0191f1aa701515392bc7bb31190ecb6dbfc5317874b04c500a220ba7e516477a"
Jul 13 16:02:52.402082 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:52.402047    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"]
Jul 13 16:02:52.402474 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:52.402308    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy" containerID="cri-o://dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3" gracePeriod=30
Jul 13 16:02:57.670371 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.670305    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:02:57.715327 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-token\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715507 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715336    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-certs\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715507 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715374    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8562n\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-kube-api-access-8562n\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715507 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715442    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-credential-socket\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715507 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715472    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-podinfo\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715507 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715496    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1c72b19-828b-4bd6-ba51-508f399b8707-istiod-ca-cert\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715772 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715525    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-socket\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715772 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715563    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-envoy\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715772 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715642    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-data\") pod \"f1c72b19-828b-4bd6-ba51-508f399b8707\" (UID: \"f1c72b19-828b-4bd6-ba51-508f399b8707\") "
Jul 13 16:02:57.715772 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715690    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:57.716016 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.715984    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:57.716080 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.716004    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-certs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.716893 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.716552    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1c72b19-828b-4bd6-ba51-508f399b8707-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:02:57.716893 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.716575    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-data" (OuterVolumeSpecName: "istio-data") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:57.716893 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.716782    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:57.717909 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.717872    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:02:57.718223 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.718192    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:57.718386 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.718332    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 16:02:57.718543 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.718514    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-kube-api-access-8562n" (OuterVolumeSpecName: "kube-api-access-8562n") pod "f1c72b19-828b-4bd6-ba51-508f399b8707" (UID: "f1c72b19-828b-4bd6-ba51-508f399b8707"). InnerVolumeSpecName "kube-api-access-8562n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:02:57.817284 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817230    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-credential-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.817481 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817294    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-podinfo\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.817481 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817310    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1c72b19-828b-4bd6-ba51-508f399b8707-istiod-ca-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.817481 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817326    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-workload-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.817481 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817340    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-envoy\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.817481 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817349    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-data\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.817481 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817357    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-istio-token\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:57.817481 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:57.817364    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8562n\" (UniqueName: \"kubernetes.io/projected/f1c72b19-828b-4bd6-ba51-508f399b8707-kube-api-access-8562n\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:02:58.498341 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.498308    2556 generic.go:356] "Generic (PLEG): container finished" podID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerID="dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3" exitCode=0
Jul 13 16:02:58.498576 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.498361    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"
Jul 13 16:02:58.498576 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.498394    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" event={"ID":"f1c72b19-828b-4bd6-ba51-508f399b8707","Type":"ContainerDied","Data":"dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3"}
Jul 13 16:02:58.498576 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.498447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw" event={"ID":"f1c72b19-828b-4bd6-ba51-508f399b8707","Type":"ContainerDied","Data":"9d8a8e767348390c04509216fc30ddc690c6a5193dc26953aa96ac215dcfb736"}
Jul 13 16:02:58.498576 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.498471    2556 scope.go:117] "RemoveContainer" containerID="dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3"
Jul 13 16:02:58.510878 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.510866    2556 scope.go:117] "RemoveContainer" containerID="093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145"
Jul 13 16:02:58.518636 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.518621    2556 scope.go:117] "RemoveContainer" containerID="dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3"
Jul 13 16:02:58.518932 ip-10-0-139-109 kubenswrapper[2556]: E0713 16:02:58.518912    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3\": container with ID starting with dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3 not found: ID does not exist" containerID="dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3"
Jul 13 16:02:58.519054 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.518943    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3"} err="failed to get container status \"dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3\": rpc error: code = NotFound desc = could not find container \"dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3\": container with ID starting with dc04fc538f1193e2f21876298059803cacc26922cf2d4f98eb0b493097658fd3 not found: ID does not exist"
Jul 13 16:02:58.519054 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.518966    2556 scope.go:117] "RemoveContainer" containerID="093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145"
Jul 13 16:02:58.519331 ip-10-0-139-109 kubenswrapper[2556]: E0713 16:02:58.519305    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145\": container with ID starting with 093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145 not found: ID does not exist" containerID="093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145"
Jul 13 16:02:58.519446 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.519339    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145"} err="failed to get container status \"093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145\": rpc error: code = NotFound desc = could not find container \"093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145\": container with ID starting with 093f1aad27169e334458bd79605b92d3145e5caa6a9a3f3ba3f0078c323f6145 not found: ID does not exist"
Jul 13 16:02:58.522132 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.522115    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"]
Jul 13 16:02:58.526286 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:58.526248    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-68976d-openshift-default-6d65cfdf7-krlhw"]
Jul 13 16:02:59.079395 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:02:59.079367    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" path="/var/lib/kubelet/pods/f1c72b19-828b-4bd6-ba51-508f399b8707/volumes"
Jul 13 16:03:01.813840 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.813800    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"]
Jul 13 16:03:01.814325 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814218    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a476809b-a5df-43f4-b23a-3c2919f4da2d" containerName="revoke-keys"
Jul 13 16:03:01.814325 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814230    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a476809b-a5df-43f4-b23a-3c2919f4da2d" containerName="revoke-keys"
Jul 13 16:03:01.814325 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814244    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy"
Jul 13 16:03:01.814325 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814253    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy"
Jul 13 16:03:01.814325 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814276    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy"
Jul 13 16:03:01.814325 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814282    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy"
Jul 13 16:03:01.814640 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814343    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy"
Jul 13 16:03:01.814640 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814351    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c72b19-828b-4bd6-ba51-508f399b8707" containerName="istio-proxy"
Jul 13 16:03:01.814640 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.814361    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a476809b-a5df-43f4-b23a-3c2919f4da2d" containerName="revoke-keys"
Jul 13 16:03:01.819161 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.819139    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.821578 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.821560    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4293a7-openshift-default-dockercfg-mrc2k\""
Jul 13 16:03:01.829170 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.829135    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"]
Jul 13 16:03:01.953338 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953298    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-token\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953517 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953380    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-socket\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953517 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-data\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953517 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istiod-ca-cert\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953640 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953556    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-podinfo\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953640 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-certs\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953708 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953670    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-envoy\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953745 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-credential-socket\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:01.953784 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:01.953764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc8mt\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-kube-api-access-tc8mt\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.054827 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.054793    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc8mt\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-kube-api-access-tc8mt\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.054827 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.054832    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-token\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055113 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.054861    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-socket\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055113 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.054878    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-data\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055113 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.054918    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istiod-ca-cert\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055113 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.054940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-podinfo\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055113 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.054961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-certs\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055113 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.055005    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-envoy\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055445 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.055135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-credential-socket\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055445 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.055336    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-socket\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055445 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.055369    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-certs\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055445 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.055401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-data\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055648 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.055590    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-credential-socket\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.055757 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.055739    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istiod-ca-cert\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.057375 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.057356    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-envoy\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.057591 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.057572    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-podinfo\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.064353 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.064301    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-token\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.064451 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.064405    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc8mt\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-kube-api-access-tc8mt\") pod \"e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") " pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.130556 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.130516    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:02.276104 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.276075    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"]
Jul 13 16:03:02.277075 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:03:02.277037    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5961757c_fda5_4c54_9c0a_5c8f908d1ff2.slice/crio-4a3c5b4da34f190fa176798f1c9adeea268f64a3484e8147035395dd872fffcd WatchSource:0}: Error finding container 4a3c5b4da34f190fa176798f1c9adeea268f64a3484e8147035395dd872fffcd: Status 404 returned error can't find the container with id 4a3c5b4da34f190fa176798f1c9adeea268f64a3484e8147035395dd872fffcd
Jul 13 16:03:02.279702 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.279667    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:03:02.279802 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.279733    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:03:02.279802 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.279761    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:03:02.526327 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.526285    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" event={"ID":"5961757c-fda5-4c54-9c0a-5c8f908d1ff2","Type":"ContainerStarted","Data":"df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c"}
Jul 13 16:03:02.526519 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.526352    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" event={"ID":"5961757c-fda5-4c54-9c0a-5c8f908d1ff2","Type":"ContainerStarted","Data":"4a3c5b4da34f190fa176798f1c9adeea268f64a3484e8147035395dd872fffcd"}
Jul 13 16:03:02.545959 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:02.545909    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podStartSLOduration=1.545890482 podStartE2EDuration="1.545890482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:03:02.544359752 +0000 UTC m=+2336.105050261" watchObservedRunningTime="2026-07-13 16:03:02.545890482 +0000 UTC m=+2336.106580970"
Jul 13 16:03:03.130962 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:03.130923    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:03.136136 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:03.136110    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:03.532183 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:03.532156    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:03.533313 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:03.533290    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:19.573497 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:19.573456    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 16:03:19.573947 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:19.573529    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 16:03:20.638404 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:20.638370    2556 generic.go:356] "Generic (PLEG): container finished" podID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerID="df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c" exitCode=0
Jul 13 16:03:20.638819 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:20.638448    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" event={"ID":"5961757c-fda5-4c54-9c0a-5c8f908d1ff2","Type":"ContainerDied","Data":"df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c"}
Jul 13 16:03:20.638907 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:20.638890    2556 scope.go:117] "RemoveContainer" containerID="df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c"
Jul 13 16:03:20.639914 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:20.639883    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:03:20.640019 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:20.639956    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:03:20.640019 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:20.639985    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 16:03:21.646170 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:21.646142    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" event={"ID":"5961757c-fda5-4c54-9c0a-5c8f908d1ff2","Type":"ContainerStarted","Data":"21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9"}
Jul 13 16:03:22.131356 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:22.131317    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:22.131606 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:22.131583    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 13 16:03:22.131668 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:22.131648    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 13 16:03:23.131283 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:23.131227    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 13 16:03:23.131664 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:23.131324    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 13 16:03:24.131362 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:24.131324    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 13 16:03:24.131741 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:24.131390    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 13 16:03:25.131520 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:25.131482    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 13 16:03:25.131901 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:25.131543    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 13 16:03:26.136741 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:26.136709    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:26.137199 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:26.136985    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:03:26.137826 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:03:26.137811    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:04:07.091869 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:04:07.091838    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 16:04:07.098757 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:04:07.098734    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 16:06:07.188749 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:06:07.188671    2556 scope.go:117] "RemoveContainer" containerID="1b3a0689e6b2d2d5f77b44ea0c1e3ed30a4f5fc5849862d82f8ef439b1ff1eca"
Jul 13 16:06:07.197286 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:06:07.197244    2556 scope.go:117] "RemoveContainer" containerID="37cb75c7bd2924f28840934e899965344488a882297c063912096bfdc033b734"
Jul 13 16:09:07.137947 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:07.137864    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 16:09:07.143026 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:07.142995    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 16:09:18.370914 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.370876    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"]
Jul 13 16:09:18.374341 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.374324    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"
Jul 13 16:09:18.376536 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.376513    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 16:09:18.376677 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.376536    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 16:09:18.380390 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.380370    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"]
Jul 13 16:09:18.447014 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.446985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa175979-e62d-42f1-bb2d-449559559d06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv\" (UID: \"aa175979-e62d-42f1-bb2d-449559559d06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"
Jul 13 16:09:18.548069 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.548038    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa175979-e62d-42f1-bb2d-449559559d06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv\" (UID: \"aa175979-e62d-42f1-bb2d-449559559d06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"
Jul 13 16:09:18.548644 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.548626    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa175979-e62d-42f1-bb2d-449559559d06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv\" (UID: \"aa175979-e62d-42f1-bb2d-449559559d06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"
Jul 13 16:09:18.686060 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.686029    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"
Jul 13 16:09:18.820055 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:18.820030    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"]
Jul 13 16:09:18.822005 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:09:18.821981    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa175979_e62d_42f1_bb2d_449559559d06.slice/crio-45118f5384d5ea79df397cd6760c9b4cf56dbf8b092caed73024f89cf393c557 WatchSource:0}: Error finding container 45118f5384d5ea79df397cd6760c9b4cf56dbf8b092caed73024f89cf393c557: Status 404 returned error can't find the container with id 45118f5384d5ea79df397cd6760c9b4cf56dbf8b092caed73024f89cf393c557
Jul 13 16:09:19.554948 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:19.554919    2556 generic.go:356] "Generic (PLEG): container finished" podID="aa175979-e62d-42f1-bb2d-449559559d06" containerID="300379f9387cef7415438af7a642b42fce3d61264cb196c17c6d0690cf5ae6c9" exitCode=0
Jul 13 16:09:19.555259 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:19.554975    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv" event={"ID":"aa175979-e62d-42f1-bb2d-449559559d06","Type":"ContainerDied","Data":"300379f9387cef7415438af7a642b42fce3d61264cb196c17c6d0690cf5ae6c9"}
Jul 13 16:09:19.555259 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:19.555027    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv" event={"ID":"aa175979-e62d-42f1-bb2d-449559559d06","Type":"ContainerStarted","Data":"45118f5384d5ea79df397cd6760c9b4cf56dbf8b092caed73024f89cf393c557"}
Jul 13 16:09:20.688095 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:20.688066    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"
Jul 13 16:09:20.767006 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:20.766980    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa175979-e62d-42f1-bb2d-449559559d06-maas-api-service-ca\") pod \"aa175979-e62d-42f1-bb2d-449559559d06\" (UID: \"aa175979-e62d-42f1-bb2d-449559559d06\") "
Jul 13 16:09:20.767342 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:20.767320    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa175979-e62d-42f1-bb2d-449559559d06-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa175979-e62d-42f1-bb2d-449559559d06" (UID: "aa175979-e62d-42f1-bb2d-449559559d06"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:09:20.868561 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:20.868471    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa175979-e62d-42f1-bb2d-449559559d06-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:09:21.566690 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:21.566657    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv" event={"ID":"aa175979-e62d-42f1-bb2d-449559559d06","Type":"ContainerDied","Data":"45118f5384d5ea79df397cd6760c9b4cf56dbf8b092caed73024f89cf393c557"}
Jul 13 16:09:21.566690 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:21.566677    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv"
Jul 13 16:09:21.566947 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:21.566705    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45118f5384d5ea79df397cd6760c9b4cf56dbf8b092caed73024f89cf393c557"
Jul 13 16:09:44.500593 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.500551    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"]
Jul 13 16:09:44.501177 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.501112    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa175979-e62d-42f1-bb2d-449559559d06" containerName="revoke-keys"
Jul 13 16:09:44.501177 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.501134    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa175979-e62d-42f1-bb2d-449559559d06" containerName="revoke-keys"
Jul 13 16:09:44.501340 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.501243    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa175979-e62d-42f1-bb2d-449559559d06" containerName="revoke-keys"
Jul 13 16:09:44.504739 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.504721    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"
Jul 13 16:09:44.507518 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.507483    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 16:09:44.507665 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.507547    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 16:09:44.512179 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.512152    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"]
Jul 13 16:09:44.594909 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.594875    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ab3501-2083-4b8c-a104-99b5d169b446-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n\" (UID: \"59ab3501-2083-4b8c-a104-99b5d169b446\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"
Jul 13 16:09:44.696320 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.696292    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ab3501-2083-4b8c-a104-99b5d169b446-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n\" (UID: \"59ab3501-2083-4b8c-a104-99b5d169b446\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"
Jul 13 16:09:44.696934 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.696917    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ab3501-2083-4b8c-a104-99b5d169b446-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n\" (UID: \"59ab3501-2083-4b8c-a104-99b5d169b446\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"
Jul 13 16:09:44.816819 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.816743    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"
Jul 13 16:09:44.950891 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:44.950859    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"]
Jul 13 16:09:44.952808 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:09:44.952784    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ab3501_2083_4b8c_a104_99b5d169b446.slice/crio-81cfbafe7282a6b4c414e862faf5ba62a8a1c978fd5fb1771dd060c997cecced WatchSource:0}: Error finding container 81cfbafe7282a6b4c414e862faf5ba62a8a1c978fd5fb1771dd060c997cecced: Status 404 returned error can't find the container with id 81cfbafe7282a6b4c414e862faf5ba62a8a1c978fd5fb1771dd060c997cecced
Jul 13 16:09:45.690937 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:45.690902    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n" event={"ID":"59ab3501-2083-4b8c-a104-99b5d169b446","Type":"ContainerStarted","Data":"35271ac646ccbcc51e76c389feacca0bc557cf623fe4c19fe161a26e1c52ae12"}
Jul 13 16:09:45.691329 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:45.690965    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n" event={"ID":"59ab3501-2083-4b8c-a104-99b5d169b446","Type":"ContainerStarted","Data":"81cfbafe7282a6b4c414e862faf5ba62a8a1c978fd5fb1771dd060c997cecced"}
Jul 13 16:09:45.707184 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:45.707132    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n" podStartSLOduration=1.707117851 podStartE2EDuration="1.707117851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:09:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:09:45.705172597 +0000 UTC m=+2739.265863082" watchObservedRunningTime="2026-07-13 16:09:45.707117851 +0000 UTC m=+2739.267808338"
Jul 13 16:09:46.697725 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:46.697691    2556 generic.go:356] "Generic (PLEG): container finished" podID="59ab3501-2083-4b8c-a104-99b5d169b446" containerID="35271ac646ccbcc51e76c389feacca0bc557cf623fe4c19fe161a26e1c52ae12" exitCode=0
Jul 13 16:09:46.698108 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:46.697737    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n" event={"ID":"59ab3501-2083-4b8c-a104-99b5d169b446","Type":"ContainerDied","Data":"35271ac646ccbcc51e76c389feacca0bc557cf623fe4c19fe161a26e1c52ae12"}
Jul 13 16:09:47.837107 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:47.837079    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"
Jul 13 16:09:47.927553 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:47.927518    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ab3501-2083-4b8c-a104-99b5d169b446-maas-api-service-ca\") pod \"59ab3501-2083-4b8c-a104-99b5d169b446\" (UID: \"59ab3501-2083-4b8c-a104-99b5d169b446\") "
Jul 13 16:09:47.927872 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:47.927850    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ab3501-2083-4b8c-a104-99b5d169b446-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59ab3501-2083-4b8c-a104-99b5d169b446" (UID: "59ab3501-2083-4b8c-a104-99b5d169b446"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:09:48.028641 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:48.028559    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ab3501-2083-4b8c-a104-99b5d169b446-maas-api-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:09:48.708626 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:48.708588    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n" event={"ID":"59ab3501-2083-4b8c-a104-99b5d169b446","Type":"ContainerDied","Data":"81cfbafe7282a6b4c414e862faf5ba62a8a1c978fd5fb1771dd060c997cecced"}
Jul 13 16:09:48.708790 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:48.708648    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81cfbafe7282a6b4c414e862faf5ba62a8a1c978fd5fb1771dd060c997cecced"
Jul 13 16:09:48.708790 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:09:48.708599    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n"
Jul 13 16:10:10.263460 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:10.263427    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"]
Jul 13 16:10:10.263907 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:10.263683    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy" containerID="cri-o://21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9" gracePeriod=30
Jul 13 16:10:11.139418 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:11.139383    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 16:10:11.139579 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:11.139438    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 16:10:15.525211 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.525153    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:10:15.573811 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.573779    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-podinfo\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.573955 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.573849    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-credential-socket\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.573955 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.573883    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-envoy\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.573955 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.573902    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-token\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.573955 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.573924    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istiod-ca-cert\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.573955 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.573946    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc8mt\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-kube-api-access-tc8mt\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.574243 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.573992    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-socket\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.574243 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574038    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-certs\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.574243 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574100    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-data\") pod \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\" (UID: \"5961757c-fda5-4c54-9c0a-5c8f908d1ff2\") "
Jul 13 16:10:15.574243 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574232    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:10:15.574502 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574305    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:10:15.574581 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574511    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-credential-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.574581 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574532    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-socket\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.574581 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574531    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:10:15.574763 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.574729    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:10:15.575187 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.575162    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-data" (OuterVolumeSpecName: "istio-data") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:10:15.576164 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.576101    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 16:10:15.576313 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.576192    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-kube-api-access-tc8mt" (OuterVolumeSpecName: "kube-api-access-tc8mt") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "kube-api-access-tc8mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:10:15.576313 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.576294    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:10:15.576586 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.576563    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-token" (OuterVolumeSpecName: "istio-token") pod "5961757c-fda5-4c54-9c0a-5c8f908d1ff2" (UID: "5961757c-fda5-4c54-9c0a-5c8f908d1ff2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:10:15.675257 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.675226    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-envoy\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.675257 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.675252    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-token\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.675257 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.675260    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istiod-ca-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.675558 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.675286    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc8mt\" (UniqueName: \"kubernetes.io/projected/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-kube-api-access-tc8mt\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.675558 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.675298    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-workload-certs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.675558 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.675306    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-data\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.675558 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.675313    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5961757c-fda5-4c54-9c0a-5c8f908d1ff2-istio-podinfo\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\""
Jul 13 16:10:15.851006 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.850915    2556 generic.go:356] "Generic (PLEG): container finished" podID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerID="21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9" exitCode=0
Jul 13 16:10:15.851006 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.850969    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" event={"ID":"5961757c-fda5-4c54-9c0a-5c8f908d1ff2","Type":"ContainerDied","Data":"21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9"}
Jul 13 16:10:15.851006 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.850977    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"
Jul 13 16:10:15.851297 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.851019    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm" event={"ID":"5961757c-fda5-4c54-9c0a-5c8f908d1ff2","Type":"ContainerDied","Data":"4a3c5b4da34f190fa176798f1c9adeea268f64a3484e8147035395dd872fffcd"}
Jul 13 16:10:15.851297 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.851043    2556 scope.go:117] "RemoveContainer" containerID="21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9"
Jul 13 16:10:15.860768 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.860748    2556 scope.go:117] "RemoveContainer" containerID="df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c"
Jul 13 16:10:15.868661 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.868644    2556 scope.go:117] "RemoveContainer" containerID="21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9"
Jul 13 16:10:15.868896 ip-10-0-139-109 kubenswrapper[2556]: E0713 16:10:15.868879    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9\": container with ID starting with 21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9 not found: ID does not exist" containerID="21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9"
Jul 13 16:10:15.868935 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.868906    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9"} err="failed to get container status \"21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9\": rpc error: code = NotFound desc = could not find container \"21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9\": container with ID starting with 21b161a8f4a4186fd47f149ab64c9da71bac5786b19925fdb722f1e8ba850bd9 not found: ID does not exist"
Jul 13 16:10:15.868935 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.868924    2556 scope.go:117] "RemoveContainer" containerID="df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c"
Jul 13 16:10:15.869179 ip-10-0-139-109 kubenswrapper[2556]: E0713 16:10:15.869160    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c\": container with ID starting with df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c not found: ID does not exist" containerID="df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c"
Jul 13 16:10:15.869284 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.869184    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c"} err="failed to get container status \"df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c\": rpc error: code = NotFound desc = could not find container \"df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c\": container with ID starting with df997dbe64961e45bbc157bf5559f905533968701110c5e5f2fb87a2ebc7c76c not found: ID does not exist"
Jul 13 16:10:15.874990 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.874963    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"]
Jul 13 16:10:15.879352 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:15.879331    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4293a7-openshift-default-95b59745f-lnfmm"]
Jul 13 16:10:16.048019 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:16.047988    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-llfp7_29a7b7bd-3339-42f9-90e0-d9e16160e702/manager/0.log"
Jul 13 16:10:16.627923 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:16.627895    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-rrjkx_f74b1839-bc26-4428-9f74-174b749f2d73/copy-manifests/0.log"
Jul 13 16:10:16.647485 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:16.647462    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-rrjkx_f74b1839-bc26-4428-9f74-174b749f2d73/manager/0.log"
Jul 13 16:10:17.078440 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:17.078408    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" path="/var/lib/kubelet/pods/5961757c-fda5-4c54-9c0a-5c8f908d1ff2/volumes"
Jul 13 16:10:17.351952 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:17.351873    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732640-wtxpg_450ff591-38df-438b-92c4-71d16a9204a2/cleanup/0.log"
Jul 13 16:10:17.466492 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:17.466465    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-70631383-kmmw5_521dab98-5b26-42ea-a724-6b3459b9e2c9/revoke-keys/0.log"
Jul 13 16:10:17.579202 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:17.579172    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-f762c5e1-9qn7v_1d8b28b5-b053-4976-ae1a-1cd4ecf7f3c2/revoke-keys/0.log"
Jul 13 16:10:17.690102 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:17.690076    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-714794-bxggz_cc6a7287-6de7-489c-9982-19e2a9da3289/revoke-keys/0.log"
Jul 13 16:10:17.810826 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:17.810800    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-68976d-rbdrm_a476809b-a5df-43f4-b23a-3c2919f4da2d/revoke-keys/0.log"
Jul 13 16:10:17.929023 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:17.928997    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-d997b9d6-749q9_d8747b23-260c-4061-b73c-dda8ad5c79da/revoke-keys/0.log"
Jul 13 16:10:18.041096 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:18.041009    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-47280f-tzc5w_565324d2-c87a-49c4-b6ff-5146b9ee8cb6/revoke-keys/0.log"
Jul 13 16:10:18.153296 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:18.153256    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-ef5b3f-skh97_011b0668-8308-4391-917b-8764fb2bf681/revoke-keys/0.log"
Jul 13 16:10:18.385707 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:18.385625    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-5461ffdf-fkmqt_0b3dcc88-bf47-428b-a2a8-7aa8900596ba/revoke-keys/0.log"
Jul 13 16:10:18.492065 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:18.492032    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-6270d141-nrpt6_1e7aac28-9cb3-4923-8fb0-1c2306b9e078/revoke-keys/0.log"
Jul 13 16:10:18.601045 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:18.601009    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-a1c3e5-wzswv_aa175979-e62d-42f1-bb2d-449559559d06/revoke-keys/0.log"
Jul 13 16:10:18.710629 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:18.710597    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-4293a7-wrx9n_59ab3501-2083-4b8c-a104-99b5d169b446/revoke-keys/0.log"
Jul 13 16:10:20.261793 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:20.261764    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4zcgz_57374d37-9c71-44da-8425-a7b979fd67e3/manager/0.log"
Jul 13 16:10:20.611587 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:20.611497    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dhbs2_16969617-35c0-41ee-9365-a783ece857bc/registry-server/0.log"
Jul 13 16:10:20.741062 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:20.741023    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mtn4d_e318a6ea-06b4-4668-8940-0f542a36e2fc/manager/0.log"
Jul 13 16:10:20.998632 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:20.998598    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-db4wh_d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e/manager/0.log"
Jul 13 16:10:21.356474 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:21.356392    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg5v4_833aae9c-60a2-4dc5-8c8c-522d715da520/istio-proxy/0.log"
Jul 13 16:10:21.482319 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:21.482294    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hmv2f_40b68ba6-2837-4404-a3ec-2caf279b52c1/discovery/0.log"
Jul 13 16:10:21.597085 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:21.597037    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-fqcqz_3994874e-5e66-4c72-8bc9-352011d490b6/kube-auth-proxy/0.log"
Jul 13 16:10:22.565483 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:22.565455    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kdp2s_eff7e808-92c4-4947-b7c5-64b1d35f8155/main/0.log"
Jul 13 16:10:22.903948 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:22.903909    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqjb8k_27ecd6ec-90f0-4762-a00e-8ee7836285e7/main/0.log"
Jul 13 16:10:30.542949 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:30.542852    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-45g28_4972f3e0-9154-4893-bd4a-f516b1ce678b/global-pull-secret-syncer/0.log"
Jul 13 16:10:30.819281 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:30.819185    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fnpsb_13320759-94ed-46fc-9340-294b88a9e1d2/konnectivity-agent/0.log"
Jul 13 16:10:30.900235 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:30.900203    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-109.ec2.internal_6f6bd2ba4ae233da88135071168265b2/haproxy/0.log"
Jul 13 16:10:35.607752 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:35.607719    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4zcgz_57374d37-9c71-44da-8425-a7b979fd67e3/manager/0.log"
Jul 13 16:10:35.727655 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:35.727626    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dhbs2_16969617-35c0-41ee-9365-a783ece857bc/registry-server/0.log"
Jul 13 16:10:35.891949 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:35.891870    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mtn4d_e318a6ea-06b4-4668-8940-0f542a36e2fc/manager/0.log"
Jul 13 16:10:36.012449 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:36.012421    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-db4wh_d0cf3e12-4b64-4b4d-a7e7-86d86fa2b87e/manager/0.log"
Jul 13 16:10:37.793170 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:37.793129    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c6cfddc96-vqkdm_0a481658-34a7-4618-aba6-f31282dbd8d4/metrics-server/0.log"
Jul 13 16:10:37.994512 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:37.994478    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lks6_58f3ad46-fac0-4c29-ac88-c57aa55765da/node-exporter/0.log"
Jul 13 16:10:38.015171 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.015148    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lks6_58f3ad46-fac0-4c29-ac88-c57aa55765da/kube-rbac-proxy/0.log"
Jul 13 16:10:38.041473 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.041455    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lks6_58f3ad46-fac0-4c29-ac88-c57aa55765da/init-textfile/0.log"
Jul 13 16:10:38.075363 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.075341    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-hpbtz_20b46f8c-d703-4b0f-ab83-724f6b621b48/kube-rbac-proxy-main/0.log"
Jul 13 16:10:38.098897 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.098874    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-hpbtz_20b46f8c-d703-4b0f-ab83-724f6b621b48/kube-rbac-proxy-self/0.log"
Jul 13 16:10:38.122510 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.122486    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-hpbtz_20b46f8c-d703-4b0f-ab83-724f6b621b48/openshift-state-metrics/0.log"
Jul 13 16:10:38.165459 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.165433    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8aa1ed-faf7-4c90-9a91-877da425a9d9/prometheus/0.log"
Jul 13 16:10:38.194729 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.194633    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8aa1ed-faf7-4c90-9a91-877da425a9d9/config-reloader/0.log"
Jul 13 16:10:38.218777 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.218754    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8aa1ed-faf7-4c90-9a91-877da425a9d9/thanos-sidecar/0.log"
Jul 13 16:10:38.239778 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.239752    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8aa1ed-faf7-4c90-9a91-877da425a9d9/kube-rbac-proxy-web/0.log"
Jul 13 16:10:38.261393 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.261373    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8aa1ed-faf7-4c90-9a91-877da425a9d9/kube-rbac-proxy/0.log"
Jul 13 16:10:38.282777 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.282756    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8aa1ed-faf7-4c90-9a91-877da425a9d9/kube-rbac-proxy-thanos/0.log"
Jul 13 16:10:38.304700 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.304679    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8aa1ed-faf7-4c90-9a91-877da425a9d9/init-config-reloader/0.log"
Jul 13 16:10:38.334091 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.334057    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-rst8t_64b95c0a-4439-47fe-ad87-2ce52c86988e/prometheus-operator/0.log"
Jul 13 16:10:38.365694 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.365667    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-rst8t_64b95c0a-4439-47fe-ad87-2ce52c86988e/kube-rbac-proxy/0.log"
Jul 13 16:10:38.527977 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.527891    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75595697f4-spj6x_f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6/thanos-query/0.log"
Jul 13 16:10:38.548704 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.548673    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75595697f4-spj6x_f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6/kube-rbac-proxy-web/0.log"
Jul 13 16:10:38.569428 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.569403    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75595697f4-spj6x_f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6/kube-rbac-proxy/0.log"
Jul 13 16:10:38.589995 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.589975    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75595697f4-spj6x_f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6/prom-label-proxy/0.log"
Jul 13 16:10:38.608760 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.608738    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75595697f4-spj6x_f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6/kube-rbac-proxy-rules/0.log"
Jul 13 16:10:38.631734 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:38.631712    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75595697f4-spj6x_f1e72f6a-e1ab-498a-8d15-3c2c9189cfe6/kube-rbac-proxy-metrics/0.log"
Jul 13 16:10:40.735544 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.735508    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"]
Jul 13 16:10:40.736107 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.735995    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59ab3501-2083-4b8c-a104-99b5d169b446" containerName="revoke-keys"
Jul 13 16:10:40.736107 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.736015    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="59ab3501-2083-4b8c-a104-99b5d169b446" containerName="revoke-keys"
Jul 13 16:10:40.736107 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.736034    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy"
Jul 13 16:10:40.736107 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.736043    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy"
Jul 13 16:10:40.736308 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.736129    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy"
Jul 13 16:10:40.736308 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.736139    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5961757c-fda5-4c54-9c0a-5c8f908d1ff2" containerName="istio-proxy"
Jul 13 16:10:40.736308 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.736147    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="59ab3501-2083-4b8c-a104-99b5d169b446" containerName="revoke-keys"
Jul 13 16:10:40.741191 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.741172    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:40.743939 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.743918    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s8tpw\"/\"default-dockercfg-qxzff\""
Jul 13 16:10:40.744057 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.743947    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8tpw\"/\"openshift-service-ca.crt\""
Jul 13 16:10:40.744057 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.743953    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8tpw\"/\"kube-root-ca.crt\""
Jul 13 16:10:40.746005 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.745973    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"]
Jul 13 16:10:40.899625 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.899595    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-sys\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:40.899809 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.899717    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-proc\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:40.899809 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.899753    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-podres\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:40.899809 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.899782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-lib-modules\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:40.899975 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:40.899838    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zz96\" (UniqueName: \"kubernetes.io/projected/6a10b123-fa0b-47d5-a07d-b63a3590fda0-kube-api-access-5zz96\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000411 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000333    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-proc\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000411 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-podres\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000411 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000395    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-lib-modules\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000674 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000475    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-proc\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000674 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zz96\" (UniqueName: \"kubernetes.io/projected/6a10b123-fa0b-47d5-a07d-b63a3590fda0-kube-api-access-5zz96\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000674 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000522    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-podres\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000674 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000555    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-sys\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000674 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000589    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-lib-modules\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.000674 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.000638    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a10b123-fa0b-47d5-a07d-b63a3590fda0-sys\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.008897 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.008870    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zz96\" (UniqueName: \"kubernetes.io/projected/6a10b123-fa0b-47d5-a07d-b63a3590fda0-kube-api-access-5zz96\") pod \"perf-node-gather-daemonset-8w7lt\" (UID: \"6a10b123-fa0b-47d5-a07d-b63a3590fda0\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.051800 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.051772    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:41.111187 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.111147    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5758758844-pbpk5_6a78e0c7-51ee-4b88-af73-e24af1639104/console/0.log"
Jul 13 16:10:41.156809 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.156777    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-49wn9_30761bef-a21f-4198-a036-815adf3134ed/download-server/0.log"
Jul 13 16:10:41.192459 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.192436    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"]
Jul 13 16:10:41.193934 ip-10-0-139-109 kubenswrapper[2556]: W0713 16:10:41.193911    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a10b123_fa0b_47d5_a07d_b63a3590fda0.slice/crio-c0a67a7dfcc9139bb4c6910548f95f89a2a5c69f2d5a181fd14fc37f12901c70 WatchSource:0}: Error finding container c0a67a7dfcc9139bb4c6910548f95f89a2a5c69f2d5a181fd14fc37f12901c70: Status 404 returned error can't find the container with id c0a67a7dfcc9139bb4c6910548f95f89a2a5c69f2d5a181fd14fc37f12901c70
Jul 13 16:10:41.991869 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.991840    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt" event={"ID":"6a10b123-fa0b-47d5-a07d-b63a3590fda0","Type":"ContainerStarted","Data":"c18ccca9002f8659bf2e7083ce09366345d398fd2732393fa5e7696d92b16743"}
Jul 13 16:10:41.992328 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.991918    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt" event={"ID":"6a10b123-fa0b-47d5-a07d-b63a3590fda0","Type":"ContainerStarted","Data":"c0a67a7dfcc9139bb4c6910548f95f89a2a5c69f2d5a181fd14fc37f12901c70"}
Jul 13 16:10:41.992328 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:41.991957    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:42.010201 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:42.010150    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt" podStartSLOduration=2.010135572 podStartE2EDuration="2.010135572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:10:42.008406792 +0000 UTC m=+2795.569097280" watchObservedRunningTime="2026-07-13 16:10:42.010135572 +0000 UTC m=+2795.570826059"
Jul 13 16:10:42.767993 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:42.767960    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9q9dk_e87b809b-2b9d-41b3-b82d-cd4c65e79d31/dns/0.log"
Jul 13 16:10:42.785225 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:42.785199    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9q9dk_e87b809b-2b9d-41b3-b82d-cd4c65e79d31/kube-rbac-proxy/0.log"
Jul 13 16:10:42.886814 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:42.886788    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26hm5_fa142aef-fab9-40a7-80d0-1631123bdf06/dns-node-resolver/0.log"
Jul 13 16:10:43.503405 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:43.503363    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2xltf_4c01fe0e-f95f-47b4-82c8-77e234befa3f/node-ca/0.log"
Jul 13 16:10:44.461540 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:44.461507    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg5v4_833aae9c-60a2-4dc5-8c8c-522d715da520/istio-proxy/0.log"
Jul 13 16:10:44.667839 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:44.667805    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hmv2f_40b68ba6-2837-4404-a3ec-2caf279b52c1/discovery/0.log"
Jul 13 16:10:44.690000 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:44.689960    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-fqcqz_3994874e-5e66-4c72-8bc9-352011d490b6/kube-auth-proxy/0.log"
Jul 13 16:10:45.560551 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:45.560523    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lsq6q_8d9015e0-b14d-489e-af21-227eccccc129/serve-healthcheck-canary/0.log"
Jul 13 16:10:46.097670 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:46.097640    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtm7d_0b4e7dc8-d490-4408-8c9d-dd85d869068d/kube-rbac-proxy/0.log"
Jul 13 16:10:46.117704 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:46.117679    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtm7d_0b4e7dc8-d490-4408-8c9d-dd85d869068d/exporter/0.log"
Jul 13 16:10:46.137962 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:46.137934    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtm7d_0b4e7dc8-d490-4408-8c9d-dd85d869068d/extractor/0.log"
Jul 13 16:10:48.007338 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:48.007310    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-8w7lt"
Jul 13 16:10:48.629910 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:48.629873    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-llfp7_29a7b7bd-3339-42f9-90e0-d9e16160e702/manager/0.log"
Jul 13 16:10:49.037066 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:49.037030    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-rrjkx_f74b1839-bc26-4428-9f74-174b749f2d73/manager/0.log"
Jul 13 16:10:49.053089 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:49.053046    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-rrjkx_f74b1839-bc26-4428-9f74-174b749f2d73/copy-manifests/0.log"
Jul 13 16:10:50.264691 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:50.264666    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vbl84_75552e6c-6c66-4bc3-a56b-1a88e9084451/openshift-lws-operator/0.log"
Jul 13 16:10:50.965611 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:50.965581    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg5v4_833aae9c-60a2-4dc5-8c8c-522d715da520/istio-proxy/0.log"
Jul 13 16:10:51.165514 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:51.165486    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hmv2f_40b68ba6-2837-4404-a3ec-2caf279b52c1/discovery/0.log"
Jul 13 16:10:51.178488 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:51.178460    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-fqcqz_3994874e-5e66-4c72-8bc9-352011d490b6/kube-auth-proxy/0.log"
Jul 13 16:10:52.585544 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:52.585503    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg5v4_833aae9c-60a2-4dc5-8c8c-522d715da520/istio-proxy/0.log"
Jul 13 16:10:52.784195 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:52.784122    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hmv2f_40b68ba6-2837-4404-a3ec-2caf279b52c1/discovery/0.log"
Jul 13 16:10:52.794138 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:52.794104    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-fqcqz_3994874e-5e66-4c72-8bc9-352011d490b6/kube-auth-proxy/0.log"
Jul 13 16:10:57.140420 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.140367    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-678q9_38aa5c7d-b417-4df7-ba26-2a19ec55a03d/kube-multus/0.log"
Jul 13 16:10:57.195633 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.195609    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9vqf_349e9302-4c8e-4893-a508-34c88849f71e/kube-multus-additional-cni-plugins/0.log"
Jul 13 16:10:57.214917 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.214891    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9vqf_349e9302-4c8e-4893-a508-34c88849f71e/egress-router-binary-copy/0.log"
Jul 13 16:10:57.234220 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.234195    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9vqf_349e9302-4c8e-4893-a508-34c88849f71e/cni-plugins/0.log"
Jul 13 16:10:57.251641 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.251621    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9vqf_349e9302-4c8e-4893-a508-34c88849f71e/bond-cni-plugin/0.log"
Jul 13 16:10:57.270636 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.270616    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9vqf_349e9302-4c8e-4893-a508-34c88849f71e/routeoverride-cni/0.log"
Jul 13 16:10:57.289469 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.289446    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9vqf_349e9302-4c8e-4893-a508-34c88849f71e/whereabouts-cni-bincopy/0.log"
Jul 13 16:10:57.311315 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.308996    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9vqf_349e9302-4c8e-4893-a508-34c88849f71e/whereabouts-cni/0.log"
Jul 13 16:10:57.742749 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.742722    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vfdrs_a0533fed-e478-491d-9721-ce22dfb30bf5/network-metrics-daemon/0.log"
Jul 13 16:10:57.757930 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:57.757905    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vfdrs_a0533fed-e478-491d-9721-ce22dfb30bf5/kube-rbac-proxy/0.log"
Jul 13 16:10:58.820735 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.820701    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-controller/0.log"
Jul 13 16:10:58.835909 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.835883    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/1.log"
Jul 13 16:10:58.835909 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.835907    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovn-acl-logging/0.log"
Jul 13 16:10:58.851417 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.851390    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/kube-rbac-proxy-node/0.log"
Jul 13 16:10:58.871646 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.871612    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/kube-rbac-proxy-ovn-metrics/0.log"
Jul 13 16:10:58.889867 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.889840    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/northd/0.log"
Jul 13 16:10:58.910733 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.910712    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/nbdb/0.log"
Jul 13 16:10:58.933162 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:58.933136    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/sbdb/0.log"
Jul 13 16:10:59.016251 ip-10-0-139-109 kubenswrapper[2556]: I0713 16:10:59.016220    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v745k_cecbcd74-fdb3-490e-a8cc-2fd7601f44d0/ovnkube-controller/0.log"